JUnit version 4.13.2
.02:12:15.089 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783476735082
02:12:15.157 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:12:15.224 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:12:15.237 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskdJk2H7/test-tmp
02:12:15.242 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:12:15.245 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskdJk2H7/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:12:15.455 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:12:15.641 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:15.642 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:12:15.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:15.646449  9390 mini_oidc.cc:150] Starting JWKS server
02:12:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:15.650095  9390 webserver.cc:533] Webserver started at http://127.0.0.1:34131/ using document root <none> and password file <none>
02:12:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:15.650624  9390 mini_oidc.cc:186] Starting OIDC Discovery server
02:12:15.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:15.653118  9390 webserver.cc:533] Webserver started at http://127.0.0.1:40317/ using document root <none> and password file <none>
02:12:15.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:12:15.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:15Z Disabled control of system clock
02:12:15.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:15.716008  9390 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:15.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:15.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal
02:12:15.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data
02:12:15.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:15.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:15.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:15.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:15.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:15.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:15.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/logs
02:12:15.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data/info.pb
02:12:15.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:15.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:15.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:15.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:15.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.190:33113
02:12:15.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.190
02:12:15.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:15.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:15.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:15.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:15.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:15.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:15.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:15.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:15.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34131/jwks.json with env {}
02:12:16.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.024281  9402 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:16.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.024852  9402 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.025328  9402 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:16.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.059862  9402 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:16.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.060169  9402 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:16.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.060374  9402 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:16.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.060691  9402 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:16.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.060966  9402 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:16.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.061120  9402 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34131/jwks.json
02:12:16.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:16.100582  9402 master_runner.cc:387] Master server non-default flags:
02:12:16.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:16.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:16.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:16.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:16.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data
02:12:16.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal
02:12:16.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:16.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:16.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:16.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.190:33113
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34131/jwks.json
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:16.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data/info.pb
02:12:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.190
02:12:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:16.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/logs
02:12:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:16.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:16.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:16.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:16.102073  9402 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:16.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:16.104300  9402 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:16.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.118145  9408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:17.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:17.521803  9407 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 9402
02:12:17.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:17.961524  9407 kernel_stack_watchdog.cc:198] Thread 9402 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
02:12:17.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:12:17.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:12:17.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:12:17.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:12:17.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:16.119073  9409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:17.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:17.962404  9402 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.844s	user 0.645s	sys 1.199s
02:12:17.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:17.962875  9402 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.845s	user 0.645s	sys 1.199s
02:12:17.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:17.964766  9411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:17.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:17.968029  9410 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1843 milliseconds
02:12:17.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.968034  9402 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:17.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.969406  9402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:17.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.971858  9402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:17.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.973208  9402 hybrid_clock.cc:648] HybridClock initialized: now 1783476737973172 us; error 51 us; skew 500 ppm
02:12:17.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.974095  9402 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.980190  9402 webserver.cc:533] Webserver started at http://127.9.43.190:42465/ using document root <none> and password file <none>
02:12:17.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.981078  9402 fs_manager.cc:362] Metadata directory not provided
02:12:17.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.981268  9402 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:17.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.981710  9402 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:17.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.986214  9402 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data/instance:
02:12:17.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1cb06e422fab4306a0f51858fdbedb8e"
02:12:17.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:17 on dist-test-slave-3kxw"
02:12:17.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.987550  9402 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal/instance:
02:12:17.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1cb06e422fab4306a0f51858fdbedb8e"
02:12:17.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:17 on dist-test-slave-3kxw"
02:12:17.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:17.997252  9402 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.003s
02:12:18.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.003106  9418 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:18.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.004526  9402 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
02:12:18.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.004923  9402 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal
02:12:18.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1cb06e422fab4306a0f51858fdbedb8e"
02:12:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:17 on dist-test-slave-3kxw"
02:12:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.005424  9402 fs_report.cc:389] FS layout report
02:12:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal
02:12:18.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal
02:12:18.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data/data
02:12:18.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:18.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:18.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:18.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.061139  9402 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:18.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.062944  9402 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:18.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.063481  9402 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:18.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.136862  9402 rpc_server.cc:307] RPC server started. Bound to: 127.9.43.190:33113
02:12:18.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.136966  9469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.43.190:33113 every 8 connection(s)
02:12:18.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.139982  9402 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/data/info.pb
02:12:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.146783  9470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:18.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.150980  9390 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 9402
02:12:18.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.151551  9390 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-0/wal/instance
02:12:18.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.157351  9390 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:18.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:18.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal
02:12:18.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data
02:12:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/logs
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data/info.pb
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:18.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:18.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:18.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:18.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:18.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:18.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:18.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.189:38561
02:12:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.189
02:12:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34131/jwks.json with env {}
02:12:18.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.165524  9470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } has no permanent_uuid. Determining permanent_uuid...
02:12:18.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.195467  9470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } has no permanent_uuid. Determining permanent_uuid...
02:12:18.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.198369  9421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:18.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.202764  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.252388  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 1
02:12:18.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.256916  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:18.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.325408  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 2
02:12:18.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.329878  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:18.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.421382  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 3
02:12:18.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.425777  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.477674  9472 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.478229  9472 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.478674  9472 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:18.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.511817  9472 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:18.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.512104  9472 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:18.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.512293  9472 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:18.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.512478  9472 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:18.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.512745  9472 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:18.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.512979  9472 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34131/jwks.json
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.550475  9472 master_runner.cc:387] Master server non-default flags:
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal
02:12:18.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.189:38561
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:18.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:18.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34131/jwks.json
02:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data/info.pb
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.189
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/logs
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.551745  9472 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.553979  9472 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.569247  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 4
02:12:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.570379  9481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:18.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.576188  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:18.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:18.875759  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 5
02:12:18.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.886746  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:19.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.434367  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 6
02:12:19.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:19.470490  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.189:38561: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:19.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:18.572467  9482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:19.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:19.954295  9484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:19.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:19.959653  9472 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.391s	user 0.470s	sys 0.913s
02:12:19.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:19.960753  9472 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.392s	user 0.471s	sys 0.915s
02:12:19.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:19.963445  9483 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1393 milliseconds
02:12:19.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.963536  9472 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:19.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.965166  9472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:19.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.968591  9472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:19.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.970423  9472 hybrid_clock.cc:648] HybridClock initialized: now 1783476739970368 us; error 54 us; skew 500 ppm
02:12:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.971653  9472 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:19.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.981048  9472 webserver.cc:533] Webserver started at http://127.9.43.189:44857/ using document root <none> and password file <none>
02:12:19.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.982440  9472 fs_manager.cc:362] Metadata directory not provided
02:12:19.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.982749  9472 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:19.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.983369  9472 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:19.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.990424  9472 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data/instance:
02:12:19.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4973e141d9914d89902427b85a5f9c2e"
02:12:19.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:19 on dist-test-slave-3kxw"
02:12:19.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:19.992179  9472 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal/instance:
02:12:19.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4973e141d9914d89902427b85a5f9c2e"
02:12:19.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:19 on dist-test-slave-3kxw"
02:12:20.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.003414  9472 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.010s	sys 0.002s
02:12:20.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.012071  9493 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:20.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.013757  9472 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
02:12:20.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.014389  9472 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal
02:12:20.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4973e141d9914d89902427b85a5f9c2e"
02:12:20.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:19 on dist-test-slave-3kxw"
02:12:20.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.014930  9472 fs_report.cc:389] FS layout report
02:12:20.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal
02:12:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal
02:12:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data/data
02:12:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:20.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:20.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:20.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:20.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:20.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:20.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.108500  9472 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:20.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.110244  9472 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:20.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.110637  9472 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:20.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.184288  9472 rpc_server.cc:307] RPC server started. Bound to: 127.9.43.189:38561
02:12:20.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.184384  9544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.43.189:38561 every 8 connection(s)
02:12:20.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.187273  9472 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/data/info.pb
02:12:20.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.194053  9545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:20.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.196970  9390 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 9472
02:12:20.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.197325  9390 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-1/wal/instance
02:12:20.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.200088  9390 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:20.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:20.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:20.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/logs
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data/info.pb
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:20.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:20.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:20.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:20.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:20.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:20.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:20.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.188:41369
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.188
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:20.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:20.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34131/jwks.json with env {}
02:12:20.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.207114  9545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } has no permanent_uuid. Determining permanent_uuid...
02:12:20.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.237998  9545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } has no permanent_uuid. Determining permanent_uuid...
02:12:20.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.252182  9545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } has no permanent_uuid. Determining permanent_uuid...
02:12:20.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.254472  9496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.258606  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.308161  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 1
02:12:20.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.312871  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.381315  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 2
02:12:20.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.385900  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.477399  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 3
02:12:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.482359  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.512414  9547 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:20.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.513006  9547 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:20.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.513473  9547 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:20.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.531118  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } attempt: 7
02:12:20.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.543619  9470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } has no permanent_uuid. Determining permanent_uuid...
02:12:20.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.549777  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.551301  9547 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:20.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.551559  9547 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:20.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.551751  9547 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:20.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.551937  9547 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:20.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.552137  9547 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:20.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.552276  9547 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34131/jwks.json
02:12:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.590248  9547 master_runner.cc:387] Master server non-default flags:
02:12:20.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:20.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:20.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:20.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:20.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data
02:12:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal
02:12:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.188:41369
02:12:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34131/jwks.json
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data/info.pb
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.188
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/logs
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:20.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:20.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.591687  9547 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:20.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.593384  9547 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:20.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.604398  9559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:20.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.609921  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 1
02:12:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.616415  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.625844  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 4
02:12:20.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.635697  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.697935  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 2
02:12:20.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.707512  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.793138  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 3
02:12:20.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.802254  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.935285  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 5
02:12:20.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:20.942725  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 4
02:12:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.952693  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:20.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.954200  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:21.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:21.237792  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 5
02:12:21.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:21.246414  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:21.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:21.500331  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 6
02:12:21.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:21.530094  9545 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:21.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:21.799003  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 6
02:12:21.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:21.830760  9470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.43.188:41369: Network error: Client connection negotiation failed: client connection to 127.9.43.188:41369: connect: Connection refused (error 111)
02:12:22.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.008471  9558 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 9547
02:12:22.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.051623  9547 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.447s	user 0.457s	sys 0.981s
02:12:22.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.052124  9547 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.448s	user 0.457s	sys 0.981s
02:12:22.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:20.605274  9560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:22.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.053932  9562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:22.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.057796  9561 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1448 milliseconds
02:12:22.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.057888  9547 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:22.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.059202  9547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:22.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.061651  9547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:22.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.063061  9547 hybrid_clock.cc:648] HybridClock initialized: now 1783476742063018 us; error 60 us; skew 500 ppm
02:12:22.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.063972  9547 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:22.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.070621  9547 webserver.cc:533] Webserver started at http://127.9.43.188:33253/ using document root <none> and password file <none>
02:12:22.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.071730  9547 fs_manager.cc:362] Metadata directory not provided
02:12:22.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.071995  9547 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:22.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.072615  9547 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:22.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.077090  9547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data/instance:
02:12:22.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec"
02:12:22.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:22 on dist-test-slave-3kxw"
02:12:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.078624  9547 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal/instance:
02:12:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec"
02:12:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:22 on dist-test-slave-3kxw"
02:12:22.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.086510  9547 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.002s
02:12:22.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.092804  9574 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:22.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.094035  9547 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
02:12:22.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.094439  9547 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal
02:12:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec"
02:12:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:22 on dist-test-slave-3kxw"
02:12:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.094913  9547 fs_report.cc:389] FS layout report
02:12:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data/data
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:22.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.171797  9547 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.173735  9547 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:22.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.174436  9547 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:22.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.247000  9547 rpc_server.cc:307] RPC server started. Bound to: 127.9.43.188:41369
02:12:22.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.247093  9625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.43.188:41369 every 8 connection(s)
02:12:22.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.249903  9547 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/data/info.pb
02:12:22.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.253841  9390 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 9547
02:12:22.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.254320  9390 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/master-2/wal/instance
02:12:22.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.257511  9626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:22.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.273996  9626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } has no permanent_uuid. Determining permanent_uuid...
02:12:22.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.300319  9626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } has no permanent_uuid. Determining permanent_uuid...
02:12:22.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.310005  9626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } has no permanent_uuid. Determining permanent_uuid...
02:12:22.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.325198  9626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: Bootstrap starting.
02:12:22.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.331568  9626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: Neither blocks nor log segments found. Creating new log.
02:12:22.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.333986  9626 log.cc:826] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: Log is configured to *not* fsync() on all Append() calls
02:12:22.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.338640  9626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: No bootstrap required, opened a new log
02:12:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.358220  9626 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.358846  9626 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:22.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.359036  9626 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ff355b8c4e3498a99c3fe74b28ef3ec, State: Initialized, Role: FOLLOWER
02:12:22.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.359781  9626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.362051  9635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:22.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.362661  9635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: This master's current role is: FOLLOWER
02:12:22.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.363529  9626 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: configured and running, proceeding with master startup.
02:12:22.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.392102  9646 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:12:22.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.392486  9646 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:12:22.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.387784  9547 master_runner.cc:187] Error getting master registration for 127.9.43.190:33113: OK, instance_id { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" instance_seqno: 1783476738116954 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:22.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.414523  9547 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.430231  9580 tablet.cc:2406] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:22.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.590619  9545 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 7
02:12:22.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.609257  9545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e: Bootstrap starting.
02:12:22.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.614750  9545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e: Neither blocks nor log segments found. Creating new log.
02:12:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.616580  9545 log.cc:826] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e: Log is configured to *not* fsync() on all Append() calls
02:12:22.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.621133  9545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e: No bootstrap required, opened a new log
02:12:22.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.640717  9545 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.641433  9545 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:22.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.641719  9545 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4973e141d9914d89902427b85a5f9c2e, State: Initialized, Role: FOLLOWER
02:12:22.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.642833  9545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.645591  9650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:22.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.646433  9650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: This master's current role is: FOLLOWER
02:12:22.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.647619  9545 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: configured and running, proceeding with master startup.
02:12:22.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.682009  9661 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:12:22.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.683773  9661 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:12:22.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.700502  9650 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:22.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.673290  9472 master_runner.cc:187] Error getting master registration for 127.9.43.190:33113: OK, instance_id { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" instance_seqno: 1783476738116954 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:22.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.701064  9650 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.707805  9472 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:22.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.710922  9650 leader_election.cc:290] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb06e422fab4306a0f51858fdbedb8e (127.9.43.190:33113), 6ff355b8c4e3498a99c3fe74b28ef3ec (127.9.43.188:41369)
02:12:22.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.711639  9601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4973e141d9914d89902427b85a5f9c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" is_pre_election: true
02:12:22.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.712504  9601 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4973e141d9914d89902427b85a5f9c2e in term 0.
02:12:22.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.713857  9496 leader_election.cc:304] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4973e141d9914d89902427b85a5f9c2e, 6ff355b8c4e3498a99c3fe74b28ef3ec; no voters: 
02:12:22.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.714962  9650 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:22.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.715291  9650 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:22.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.715587  9650 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 0 FOLLOWER]: Advancing to term 1
02:12:22.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.726328  9650 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.735862  9601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4973e141d9914d89902427b85a5f9c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec"
02:12:22.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.736443  9601 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 0 FOLLOWER]: Advancing to term 1
02:12:22.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.744323  9601 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4973e141d9914d89902427b85a5f9c2e in term 1.
02:12:22.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.746292  9650 leader_election.cc:290] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [CANDIDATE]: Term 1 election: Requested vote from peers 1cb06e422fab4306a0f51858fdbedb8e (127.9.43.190:33113), 6ff355b8c4e3498a99c3fe74b28ef3ec (127.9.43.188:41369)
02:12:22.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.746333  9496 leader_election.cc:304] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4973e141d9914d89902427b85a5f9c2e, 6ff355b8c4e3498a99c3fe74b28ef3ec; no voters: 
02:12:22.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.747599  9650 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 1 FOLLOWER]: Leader election won for term 1
02:12:22.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.751176  9650 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [term 1 LEADER]: Becoming Leader. State: Replica: 4973e141d9914d89902427b85a5f9c2e, State: Running, Role: LEADER
02:12:22.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.752460  9650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.771562  9663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4973e141d9914d89902427b85a5f9c2e. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:22.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.773687  9663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: This master's current role is: LEADER
02:12:22.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.779276  9666 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:22.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.786896  9666 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:22.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.809305  9601 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Refusing update from remote peer 4973e141d9914d89902427b85a5f9c2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:22.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.811610  9663 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:22.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.841120  9635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4973e141d9914d89902427b85a5f9c2e. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:22.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.842757  9635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: This master's current role is: FOLLOWER
02:12:22.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.856479  9668 mvcc.cc:204] Tried to move back new op lower bound from 7305120738512048128 to 7305120738341203968. Current Snapshot: MvccSnapshot[applied={T|T < 7305120738512048128}]
02:12:22.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.858348  9666 catalog_manager.cc:1383] Generated new cluster ID: 924ee198371e41a2b61aa0f623e8c561
02:12:22.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.858651  9666 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:22.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.862353  9663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:22.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.863056  9663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: This master's current role is: LEADER
02:12:22.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.864265  9470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } attempt: 7
02:12:22.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.864987  9635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:22.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.865664  9635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: This master's current role is: FOLLOWER
02:12:22.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.913134  9666 catalog_manager.cc:1406] Generated new certificate authority record
02:12:22.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.915693  9666 catalog_manager.cc:1540] Loading token signing keys...
02:12:22.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.915902  9470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: Bootstrap starting.
02:12:22.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.937664  9470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: Neither blocks nor log segments found. Creating new log.
02:12:22.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.940447  9470 log.cc:826] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: Log is configured to *not* fsync() on all Append() calls
02:12:22.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.951493  9470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: No bootstrap required, opened a new log
02:12:22.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.959348  9666 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e: Generated new TSK 0
02:12:22.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.960434  9666 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:22.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.983500  9470 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.984447  9470 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.984730  9470 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb06e422fab4306a0f51858fdbedb8e, State: Initialized, Role: FOLLOWER
02:12:22.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.985713  9470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:22.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.991511  9470 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: configured and running, proceeding with master startup.
02:12:23.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.992755  9443 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 0 FOLLOWER]: Advancing to term 1
02:12:23.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.999154  9445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4973e141d9914d89902427b85a5f9c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb06e422fab4306a0f51858fdbedb8e" is_pre_election: true
02:12:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.991679  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4973e141d9914d89902427b85a5f9c2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb06e422fab4306a0f51858fdbedb8e"
02:12:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.008888  9390 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal
02:12:23.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:23.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/logs
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data/info.pb
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:23.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:23.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:23.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.129:0
02:12:23.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.43.129
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.129
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:23.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:23.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.033370  9443 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 1 FOLLOWER]: Refusing update from remote peer 4973e141d9914d89902427b85a5f9c2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:23.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.990286  9674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:23.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.043318  9674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: This master's current role is: FOLLOWER
02:12:23.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.045667  9650 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:12:23.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.075333  9424 tablet.cc:2406] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:23.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.128705  9674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4973e141d9914d89902427b85a5f9c2e. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:23.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.129376  9674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: This master's current role is: FOLLOWER
02:12:23.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.130823  9688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:23.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.131573  9688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: This master's current role is: FOLLOWER
02:12:23.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.201697  9691 catalog_manager.cc:1295] Loaded cluster ID: 924ee198371e41a2b61aa0f623e8c561
02:12:23.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.207623  9691 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: loading cluster ID for follower catalog manager: success
02:12:23.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.233875  9691 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: acquiring CA information for follower catalog manager: success
02:12:23.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.241711  9691 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.398475  9646 catalog_manager.cc:1295] Loaded cluster ID: 924ee198371e41a2b61aa0f623e8c561
02:12:23.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.398777  9646 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: loading cluster ID for follower catalog manager: success
02:12:23.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.418059  9646 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: acquiring CA information for follower catalog manager: success
02:12:23.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.423840  9646 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:23.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.475306  9650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4973e141d9914d89902427b85a5f9c2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:23.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.476050  9650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4973e141d9914d89902427b85a5f9c2e [sys.catalog]: This master's current role is: LEADER
02:12:23.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.853772  9680 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:23.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.854897  9680 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:23.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.856045  9680 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:23.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.919559  9680 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:23.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.921514  9680 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.43.129
02:12:24.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.006805  9680 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:24.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:24.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:24.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:24.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.129:0
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data/info.pb
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.129
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:24.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.43.129
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/logs
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:24.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:24.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:24.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:24.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:24.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:24.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.019207  9680 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:24.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.022683  9680 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:24.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.058271  9700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:27.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:25.453320  9699 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 9680
02:12:27.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.195451  9680 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 3.123s	user 0.559s	sys 1.166s
02:12:27.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.196466  9680 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 3.124s	user 0.560s	sys 1.166s
02:12:27.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.076382  9701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:27.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.199093  9703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:27.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.202234  9680 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:27.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.202174  9702 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 3111 milliseconds
02:12:27.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.203820  9680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:27.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.206097  9680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:27.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.207510  9680 hybrid_clock.cc:648] HybridClock initialized: now 1783476747207474 us; error 39 us; skew 500 ppm
02:12:27.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.208458  9680 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:27.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.217532  9680 webserver.cc:533] Webserver started at http://127.9.43.129:46451/ using document root <none> and password file <none>
02:12:27.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.218677  9680 fs_manager.cc:362] Metadata directory not provided
02:12:27.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.218964  9680 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:27.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.219566  9680 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:27.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.224376  9680 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data/instance:
02:12:27.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0645fa9b096d44118e7346e52f19cdc7"
02:12:27.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:27 on dist-test-slave-3kxw"
02:12:27.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.225783  9680 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal/instance:
02:12:27.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0645fa9b096d44118e7346e52f19cdc7"
02:12:27.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:27 on dist-test-slave-3kxw"
02:12:27.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.233731  9680 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
02:12:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.240923  9713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:27.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.242390  9680 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.002s
02:12:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.242815  9680 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal
02:12:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0645fa9b096d44118e7346e52f19cdc7"
02:12:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:27 on dist-test-slave-3kxw"
02:12:27.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.243276  9680 fs_report.cc:389] FS layout report
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data/data
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:27.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:27.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:27.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.301376  9680 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:27.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.302917  9680 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:27.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.303432  9680 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:27.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.306067  9680 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:27.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.310207  9680 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:27.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.310401  9680 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:27.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.310591  9680 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:27.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.310726  9680 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:27.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.320828  9541 debug-util.cc:398] Leaking SignalData structure 0x7b080007d240 after lost signal to thread 9476
02:12:27.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.321717  9541 debug-util.cc:398] Leaking SignalData structure 0x7b0800070200 after lost signal to thread 9544
02:12:27.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.545112  9680 rpc_server.cc:307] RPC server started. Bound to: 127.9.43.129:33977
02:12:27.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.545248  9826 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.43.129:33977 every 8 connection(s)
02:12:27.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.548370  9680 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/data/info.pb
02:12:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.558651  9390 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 9680
02:12:27.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.559379  9390 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-0/wal/instance
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.592612  9390 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:27.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/logs
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data/info.pb
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:27.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.130:0
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.43.130
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.130
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:27.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:27.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.604979  9827 heartbeater.cc:344] Connected to a master server at 127.9.43.188:41369
02:12:27.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.605566  9827 heartbeater.cc:461] Registering TS with master...
02:12:27.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.607182  9829 heartbeater.cc:344] Connected to a master server at 127.9.43.190:33113
02:12:27.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.607208  9827 heartbeater.cc:507] Master 127.9.43.188:41369 requested a full tablet report, sending...
02:12:27.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.607699  9829 heartbeater.cc:461] Registering TS with master...
02:12:27.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.608724  9829 heartbeater.cc:507] Master 127.9.43.190:33113 requested a full tablet report, sending...
02:12:27.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.611719  9591 ts_manager.cc:194] Registered new tserver with Master: 0645fa9b096d44118e7346e52f19cdc7 (127.9.43.129:33977)
02:12:27.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.612493  9828 heartbeater.cc:344] Connected to a master server at 127.9.43.189:38561
02:12:27.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.612931  9828 heartbeater.cc:461] Registering TS with master...
02:12:27.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.614270  9828 heartbeater.cc:507] Master 127.9.43.189:38561 requested a full tablet report, sending...
02:12:27.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.615610  9435 ts_manager.cc:194] Registered new tserver with Master: 0645fa9b096d44118e7346e52f19cdc7 (127.9.43.129:33977)
02:12:27.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.617596  9510 ts_manager.cc:194] Registered new tserver with Master: 0645fa9b096d44118e7346e52f19cdc7 (127.9.43.129:33977)
02:12:27.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.621011  9510 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.43.129:33505
02:12:28.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.026484  9837 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:28.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.026965  9837 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:28.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.027395  9837 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:28.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.061123  9837 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:28.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.061935  9837 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.43.130
02:12:28.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.102255  9837 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:28.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.130:0
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data/info.pb
02:12:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.130
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.43.130
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/logs
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:28.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:28.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:28.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:28.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.103752  9837 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:28.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.105973  9837 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:28.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.122937  9843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.627010  9828 heartbeater.cc:499] Master 127.9.43.189:38561 was elected leader, sending a full tablet report...
02:12:30.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.126116  9844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:30.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.524328  9842 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 9837
02:12:30.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.069058  9837 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.946s	user 0.613s	sys 1.068s
02:12:30.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.070815  9837 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.948s	user 0.613s	sys 1.068s
02:12:30.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.071249  9846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:30.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.071337  9837 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:30.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.070407  9845 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1945 milliseconds
02:12:30.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.075953  9837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:30.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.078408  9837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:30.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.079839  9837 hybrid_clock.cc:648] HybridClock initialized: now 1783476750079786 us; error 61 us; skew 500 ppm
02:12:30.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.080757  9837 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:30.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.087572  9837 webserver.cc:533] Webserver started at http://127.9.43.130:39701/ using document root <none> and password file <none>
02:12:30.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.088618  9837 fs_manager.cc:362] Metadata directory not provided
02:12:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.088871  9837 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.089375  9837 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:30.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.093885  9837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data/instance:
02:12:30.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a81bfc1d005a449289504a147841416a"
02:12:30.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:30 on dist-test-slave-3kxw"
02:12:30.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.095181  9837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal/instance:
02:12:30.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a81bfc1d005a449289504a147841416a"
02:12:30.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:30 on dist-test-slave-3kxw"
02:12:30.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.103333  9837 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.006s
02:12:30.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.111116  9854 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:30.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.112607  9837 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.004s
02:12:30.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.113050  9837 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal
02:12:30.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a81bfc1d005a449289504a147841416a"
02:12:30.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:30 on dist-test-slave-3kxw"
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.113505  9837 fs_report.cc:389] FS layout report
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data/data
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:30.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:30.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:30.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:30.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:30.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:30.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:30.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.201423  9837 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:30.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.203161  9837 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:30.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.203734  9837 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:30.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.206908  9837 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.211747  9837 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.212016  9837 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.212332  9837 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:30.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.212576  9837 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:30.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.419153  9837 rpc_server.cc:307] RPC server started. Bound to: 127.9.43.130:41261
02:12:30.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.419261  9967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.43.130:41261 every 8 connection(s)
02:12:30.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.421870  9837 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/data/info.pb
02:12:30.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.430080  9390 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 9837
02:12:30.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.430548  9390 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-1/wal/instance
02:12:30.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.444677  9390 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:30.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:30.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal
02:12:30.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/logs
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data/info.pb
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:30.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.131:0
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.43.131
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.131
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:30.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:30.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.470331  9970 heartbeater.cc:344] Connected to a master server at 127.9.43.190:33113
02:12:30.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.470916  9970 heartbeater.cc:461] Registering TS with master...
02:12:30.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.472424  9970 heartbeater.cc:507] Master 127.9.43.190:33113 requested a full tablet report, sending...
02:12:30.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.475307  9969 heartbeater.cc:344] Connected to a master server at 127.9.43.189:38561
02:12:30.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.475723  9968 heartbeater.cc:344] Connected to a master server at 127.9.43.188:41369
02:12:30.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.475754  9969 heartbeater.cc:461] Registering TS with master...
02:12:30.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.476190  9968 heartbeater.cc:461] Registering TS with master...
02:12:30.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.477916  9969 heartbeater.cc:507] Master 127.9.43.189:38561 requested a full tablet report, sending...
02:12:30.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.478384  9435 ts_manager.cc:194] Registered new tserver with Master: a81bfc1d005a449289504a147841416a (127.9.43.130:41261)
02:12:30.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.484179  9968 heartbeater.cc:507] Master 127.9.43.188:41369 requested a full tablet report, sending...
02:12:30.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.486274  9510 ts_manager.cc:194] Registered new tserver with Master: a81bfc1d005a449289504a147841416a (127.9.43.130:41261)
02:12:30.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.488240  9591 ts_manager.cc:194] Registered new tserver with Master: a81bfc1d005a449289504a147841416a (127.9.43.130:41261)
02:12:30.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.488574  9510 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.43.130:36221
02:12:30.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.804224  9978 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:30.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.804697  9978 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:30.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.805102  9978 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:30.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.837776  9978 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:30.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.838589  9978 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.43.131
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.875756  9978 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.43.148:33261
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.43.131:0
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data/info.pb
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.43.131
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:30.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.43.190:33113,127.9.43.189:38561,127.9.43.188:41369
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.43.131
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/logs
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:30.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.877143  9978 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:30.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.878750  9978 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:30.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.890830  9985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:31.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.493265  9969 heartbeater.cc:499] Master 127.9.43.189:38561 was elected leader, sending a full tablet report...
02:12:32.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.298872  9984 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 9978
02:12:32.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:30.892803  9986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.490274  9984 kernel_stack_watchdog.cc:198] Thread 9978 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.490881  9978 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.599s	user 0.513s	sys 1.013s
02:12:32.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.492023  9978 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.600s	user 0.514s	sys 1.014s
02:12:32.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.493877  9988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:32.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.500350  9987 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1598 milliseconds
02:12:32.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.500381  9978 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:32.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.501981  9978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:32.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.504441  9978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:32.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.505901  9978 hybrid_clock.cc:648] HybridClock initialized: now 1783476752505805 us; error 38 us; skew 500 ppm
02:12:32.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.506853  9978 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:32.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.515332  9978 webserver.cc:533] Webserver started at http://127.9.43.131:34125/ using document root <none> and password file <none>
02:12:32.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.516386  9978 fs_manager.cc:362] Metadata directory not provided
02:12:32.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.516630  9978 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:32.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.517159  9978 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:32.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.521934  9978 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data/instance:
02:12:32.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2"
02:12:32.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:32 on dist-test-slave-3kxw"
02:12:32.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.523224  9978 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal/instance:
02:12:32.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2"
02:12:32.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:32 on dist-test-slave-3kxw"
02:12:32.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.531638  9978 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.008s
02:12:32.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.537909  9995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.539089  9978 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
02:12:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.539486  9978 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2"
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:32 on dist-test-slave-3kxw"
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.539880  9978 fs_report.cc:389] FS layout report
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data/data
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:32.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:32.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.593109  9978 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:32.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.594784  9978 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:32.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.595327  9978 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:32.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.598045  9978 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:32.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.604156  9978 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:32.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.604357  9978 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:32.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.604547  9978 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:32.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.604684  9978 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:32.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.783601  9978 rpc_server.cc:307] RPC server started. Bound to: 127.9.43.131:46163
02:12:32.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.783749 10108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.43.131:46163 every 8 connection(s)
02:12:32.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.786293  9978 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/data/info.pb
02:12:32.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.789570  9390 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 9978
02:12:32.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.790068  9390 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster616532837152472756/ts-2/wal/instance
02:12:32.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.843987 10110 heartbeater.cc:344] Connected to a master server at 127.9.43.189:38561
02:12:32.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.844503 10110 heartbeater.cc:461] Registering TS with master...
02:12:32.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.844731 10111 heartbeater.cc:344] Connected to a master server at 127.9.43.190:33113
02:12:32.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.845152 10111 heartbeater.cc:461] Registering TS with master...
02:12:32.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.845983 10110 heartbeater.cc:507] Master 127.9.43.189:38561 requested a full tablet report, sending...
02:12:32.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.846700 10111 heartbeater.cc:507] Master 127.9.43.190:33113 requested a full tablet report, sending...
02:12:32.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.847105 10109 heartbeater.cc:344] Connected to a master server at 127.9.43.188:41369
02:12:32.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.847438 10109 heartbeater.cc:461] Registering TS with master...
02:12:32.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.848436 10109 heartbeater.cc:507] Master 127.9.43.188:41369 requested a full tablet report, sending...
02:12:32.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.849447  9510 ts_manager.cc:194] Registered new tserver with Master: 7eb694d3b9fa424f8372bc67ac2b0cc2 (127.9.43.131:46163)
02:12:32.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.849663  9435 ts_manager.cc:194] Registered new tserver with Master: 7eb694d3b9fa424f8372bc67ac2b0cc2 (127.9.43.131:46163)
02:12:32.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.851148  9591 ts_manager.cc:194] Registered new tserver with Master: 7eb694d3b9fa424f8372bc67ac2b0cc2 (127.9.43.131:46163)
02:12:32.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.851228  9510 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.43.131:56687
02:12:32.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.872133  9390 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:12:32.886 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:32.887 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:12:32.897 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.43.190"
      port: 33113
    }
    bound_http_address {
      host: "127.9.43.190"
      port: 42465
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.43.189"
      port: 38561
    }
    bound_http_address {
      host: "127.9.43.189"
      port: 44857
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.43.188"
      port: 41369
    }
    bound_http_address {
      host: "127.9.43.188"
      port: 33253
    }
  }
}

02:12:32.900 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:12:32.902 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.43.129"
      port: 33977
    }
    bound_http_address {
      host: "127.9.43.129"
      port: 46451
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.43.130"
      port: 41261
    }
    bound_http_address {
      host: "127.9.43.130"
      port: 39701
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.43.131"
      port: 46163
    }
    bound_http_address {
      host: "127.9.43.131"
      port: 34125
    }
  }
}

02:12:32.902 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:12:33.087 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
02:12:33.144 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:12:33.225 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:12:33.303 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:33.362 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.43.188:41369(127.9.43.188:41369)] connecting to peer
02:12:33.364 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.43.190:33113(127.9.43.190:33113)] connecting to peer
02:12:33.382 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.43.188:41369(127.9.43.188:41369)] Successfully connected to peer
02:12:33.385 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.43.190:33113(127.9.43.190:33113)] Successfully connected to peer
02:12:33.395 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.43.189:38561(127.9.43.189:38561)] Successfully connected to peer
02:12:33.501 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.9.43.190
02:12:33.501 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.9.43.189
02:12:33.501 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.9.43.188
02:12:33.725 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x4fa18a7f, L:/127.0.0.1:44846 - R:/127.9.43.189:38561] using SASL/PLAIN
02:12:33.725 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x6ad2434e, L:/127.0.0.1:36436 - R:/127.9.43.190:33113] using SASL/PLAIN
02:12:33.725 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x8993776b, L:/127.0.0.1:37892 - R:/127.9.43.188:41369] using SASL/PLAIN
02:12:33.759 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:33.760 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=505), Traces: [0ms] refreshing cache from master, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [476ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [476ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [476ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: OK, deferred=null) after lookup
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.813360  9510 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44846:
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=OPEN_TABLE"
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:33.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:33.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:33.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:33.817960  9510 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=OPEN_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:12:33.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.854202 10110 heartbeater.cc:499] Master 127.9.43.189:38561 was elected leader, sending a full tablet report...
02:12:33.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.918321  9902 tablet_service.cc:1511] Processing CreateTablet for tablet d2e6de54b23143b9bd04bc1f3a342f66 (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=8b2a33188a544c1991baba6259406d0e]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:33.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.921581  9902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e6de54b23143b9bd04bc1f3a342f66. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:33.925 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8b2a33188a544c1991baba6259406d0e
02:12:33.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.930235 10043 tablet_service.cc:1511] Processing CreateTablet for tablet d2e6de54b23143b9bd04bc1f3a342f66 (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=8b2a33188a544c1991baba6259406d0e]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:33.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.932868 10043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e6de54b23143b9bd04bc1f3a342f66. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.934041  9761 tablet_service.cc:1511] Processing CreateTablet for tablet d2e6de54b23143b9bd04bc1f3a342f66 (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=8b2a33188a544c1991baba6259406d0e]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.936458  9761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e6de54b23143b9bd04bc1f3a342f66. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:33.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.971534 10144 tablet_bootstrap.cc:492] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: Bootstrap starting.
02:12:33.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.976840 10145 tablet_bootstrap.cc:492] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: Bootstrap starting.
02:12:33.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.977455 10143 tablet_bootstrap.cc:492] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: Bootstrap starting.
02:12:33.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.986814 10143 tablet_bootstrap.cc:654] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: Neither blocks nor log segments found. Creating new log.
02:12:33.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.989104 10144 tablet_bootstrap.cc:654] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: Neither blocks nor log segments found. Creating new log.
02:12:33.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.989850 10143 log.cc:826] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: Log is configured to *not* fsync() on all Append() calls
02:12:33.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.991719 10145 tablet_bootstrap.cc:654] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: Neither blocks nor log segments found. Creating new log.
02:12:33.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.992493 10144 log.cc:826] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: Log is configured to *not* fsync() on all Append() calls
02:12:33.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.995386 10145 log.cc:826] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: Log is configured to *not* fsync() on all Append() calls
02:12:33.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.997027 10143 tablet_bootstrap.cc:492] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: No bootstrap required, opened a new log
02:12:33.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.997727 10143 ts_tablet_manager.cc:1403] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
02:12:34.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.002490 10144 tablet_bootstrap.cc:492] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: No bootstrap required, opened a new log
02:12:34.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.006747 10144 ts_tablet_manager.cc:1403] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.005s
02:12:34.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.014118 10145 tablet_bootstrap.cc:492] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: No bootstrap required, opened a new log
02:12:34.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.014791 10145 ts_tablet_manager.cc:1403] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.016s
02:12:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.027347 10143 raft_consensus.cc:359] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.028348 10143 raft_consensus.cc:385] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:34.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.028771 10143 raft_consensus.cc:740] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a81bfc1d005a449289504a147841416a, State: Initialized, Role: FOLLOWER
02:12:34.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.030258 10143 consensus_queue.cc:260] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.035006 10143 ts_tablet_manager.cc:1434] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: Time spent starting tablet: real 0.037s	user 0.032s	sys 0.004s
02:12:34.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.045186 10144 raft_consensus.cc:359] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.046403 10144 raft_consensus.cc:385] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:34.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.046778 10144 raft_consensus.cc:740] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb694d3b9fa424f8372bc67ac2b0cc2, State: Initialized, Role: FOLLOWER
02:12:34.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.047932 10144 consensus_queue.cc:260] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.052873 10145 raft_consensus.cc:359] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.053733 10145 raft_consensus.cc:385] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:34.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.054060 10145 raft_consensus.cc:740] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0645fa9b096d44118e7346e52f19cdc7, State: Initialized, Role: FOLLOWER
02:12:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.055186 10145 consensus_queue.cc:260] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.055776 10144 ts_tablet_manager.cc:1434] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: Time spent starting tablet: real 0.048s	user 0.026s	sys 0.016s
02:12:34.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.060015 10145 ts_tablet_manager.cc:1434] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: Time spent starting tablet: real 0.045s	user 0.029s	sys 0.011s
02:12:34.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.074707 10114 tablet.cc:2406] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:34.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.100438  9836 tablet.cc:2406] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:34.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.203190  9972 tablet.cc:2406] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:34.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.251374 10149 raft_consensus.cc:493] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:34.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.251976 10149 raft_consensus.cc:515] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.255033 10149 leader_election.cc:290] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb694d3b9fa424f8372bc67ac2b0cc2 (127.9.43.131:46163), 0645fa9b096d44118e7346e52f19cdc7 (127.9.43.129:33977)
02:12:34.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.275094 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e6de54b23143b9bd04bc1f3a342f66" candidate_uuid: "a81bfc1d005a449289504a147841416a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" is_pre_election: true
02:12:34.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.276129 10063 raft_consensus.cc:2468] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81bfc1d005a449289504a147841416a in term 0.
02:12:34.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.278505  9857 leader_election.cc:304] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb694d3b9fa424f8372bc67ac2b0cc2, a81bfc1d005a449289504a147841416a; no voters: 
02:12:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.279901 10149 raft_consensus.cc:2804] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.280278 10149 raft_consensus.cc:493] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.280640 10149 raft_consensus.cc:3060] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 0 FOLLOWER]: Advancing to term 1
02:12:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.283279  9781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e6de54b23143b9bd04bc1f3a342f66" candidate_uuid: "a81bfc1d005a449289504a147841416a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0645fa9b096d44118e7346e52f19cdc7" is_pre_election: true
02:12:34.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.284194  9781 raft_consensus.cc:2468] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a81bfc1d005a449289504a147841416a in term 0.
02:12:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.287933 10149 raft_consensus.cc:515] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.290632 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e6de54b23143b9bd04bc1f3a342f66" candidate_uuid: "a81bfc1d005a449289504a147841416a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2"
02:12:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.290726  9781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e6de54b23143b9bd04bc1f3a342f66" candidate_uuid: "a81bfc1d005a449289504a147841416a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0645fa9b096d44118e7346e52f19cdc7"
02:12:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.291196  9781 raft_consensus.cc:3060] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [term 0 FOLLOWER]: Advancing to term 1
02:12:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.291180 10063 raft_consensus.cc:3060] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [term 0 FOLLOWER]: Advancing to term 1
02:12:34.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.298285  9781 raft_consensus.cc:2468] T d2e6de54b23143b9bd04bc1f3a342f66 P 0645fa9b096d44118e7346e52f19cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81bfc1d005a449289504a147841416a in term 1.
02:12:34.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.298448 10063 raft_consensus.cc:2468] T d2e6de54b23143b9bd04bc1f3a342f66 P 7eb694d3b9fa424f8372bc67ac2b0cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a81bfc1d005a449289504a147841416a in term 1.
02:12:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.299633  9858 leader_election.cc:304] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0645fa9b096d44118e7346e52f19cdc7, a81bfc1d005a449289504a147841416a; no voters: 
02:12:34.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.300624 10149 leader_election.cc:290] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [CANDIDATE]: Term 1 election: Requested vote from peers 7eb694d3b9fa424f8372bc67ac2b0cc2 (127.9.43.131:46163), 0645fa9b096d44118e7346e52f19cdc7 (127.9.43.129:33977)
02:12:34.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.303853 10149 raft_consensus.cc:2804] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 1 FOLLOWER]: Leader election won for term 1
02:12:34.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.304702 10149 raft_consensus.cc:697] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [term 1 LEADER]: Becoming Leader. State: Replica: a81bfc1d005a449289504a147841416a, State: Running, Role: LEADER
02:12:34.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.306124 10149 consensus_queue.cc:237] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } }
02:12:34.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.319960  9506 catalog_manager.cc:5697] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a reported cstate change: term changed from 0 to 1, leader changed from <none> to a81bfc1d005a449289504a147841416a (127.9.43.130). New cstate: current_term: 1 leader_uuid: "a81bfc1d005a449289504a147841416a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a81bfc1d005a449289504a147841416a" member_type: VOTER last_known_addr { host: "127.9.43.130" port: 41261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 } health_report { overall_health: UNKNOWN } } }
02:12:34.457 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.9.43.189:38561
02:12:34.458 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 1
  }
}

02:12:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.459333  9390 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 9472
02:12:34.488 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:12:34.490 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.43.189:38561(127.9.43.189:38561)] handling channelInactive
02:12:34.491 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state READY due to: connection closed
02:12:34.491 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location master-127.9.43.189:38561(127.9.43.189:38561) for tablet Kudu Master: connection closed
02:12:34.499 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.507 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.507 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.507 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.510 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.519 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.522 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.522 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.523 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.525 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.539 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.541 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.541 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.542 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.544 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.559 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.562 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.562 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.562 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.565 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.599 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.602 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.602 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.602 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.605 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.659 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.660 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.660 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.661 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.664 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.786808 10154 consensus_queue.cc:1048] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0645fa9b096d44118e7346e52f19cdc7" member_type: VOTER last_known_addr { host: "127.9.43.129" port: 33977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:34.799 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.809 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.809 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.814 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.826774  9969 heartbeater.cc:646] Failed to heartbeat to 127.9.43.189:38561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:34.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.830751 10167 consensus_queue.cc:1048] T d2e6de54b23143b9bd04bc1f3a342f66 P a81bfc1d005a449289504a147841416a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb694d3b9fa424f8372bc67ac2b0cc2" member_type: VOTER last_known_addr { host: "127.9.43.131" port: 46163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:12:34.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.834074  9828 heartbeater.cc:646] Failed to heartbeat to 127.9.43.189:38561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:34.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.853212 10110 heartbeater.cc:646] Failed to heartbeat to 127.9.43.189:38561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:34.959 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.961 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.962 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.962 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.964 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:34.979 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:34.980 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.980 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.980 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:34.984 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:35.299 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:35.300 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:35.301 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:35.301 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:35.304 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113; will retry
02:12:35.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.838711 10177 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4973e141d9914d89902427b85a5f9c2e)
02:12:35.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.839293 10177 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:35.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.843086  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1cb06e422fab4306a0f51858fdbedb8e" is_pre_election: true
02:12:35.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.843847  9444 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ff355b8c4e3498a99c3fe74b28ef3ec in term 1.
02:12:35.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.845664  9576 leader_election.cc:304] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb06e422fab4306a0f51858fdbedb8e, 6ff355b8c4e3498a99c3fe74b28ef3ec; no voters: 
02:12:35.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.847100 10180 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Leader pre-election won for term 2
02:12:35.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.847659 10180 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4973e141d9914d89902427b85a5f9c2e)
02:12:35.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.848179 10180 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 1 FOLLOWER]: Advancing to term 2
02:12:35.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.853312 10179 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4973e141d9914d89902427b85a5f9c2e)
02:12:35.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.854254 10179 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:35.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.857517 10177 leader_election.cc:290] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb06e422fab4306a0f51858fdbedb8e (127.9.43.190:33113), 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561)
02:12:35.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.857892 10180 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:35.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.862777 10180 leader_election.cc:290] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [CANDIDATE]: Term 2 election: Requested vote from peers 1cb06e422fab4306a0f51858fdbedb8e (127.9.43.190:33113), 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561)
02:12:35.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.865329  9577 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:35.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.865845  9600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1cb06e422fab4306a0f51858fdbedb8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" is_pre_election: true
02:12:35.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.866819  9600 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cb06e422fab4306a0f51858fdbedb8e in current term 2: Already voted for candidate 6ff355b8c4e3498a99c3fe74b28ef3ec in this term.
02:12:35.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.866602  9421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111) [suppressed 13 similar messages]
02:12:35.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.868001 10179 leader_election.cc:290] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561), 6ff355b8c4e3498a99c3fe74b28ef3ec (127.9.43.188:41369)
02:12:35.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.871816  9444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1cb06e422fab4306a0f51858fdbedb8e"
02:12:35.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.872381  9444 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 1 FOLLOWER]: Advancing to term 2
02:12:35.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.873442  9421 leader_election.cc:336] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561): Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:35.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.873930  9421 leader_election.cc:304] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cb06e422fab4306a0f51858fdbedb8e; no voters: 4973e141d9914d89902427b85a5f9c2e, 6ff355b8c4e3498a99c3fe74b28ef3ec
02:12:35.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.876482  9577 leader_election.cc:336] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561): Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:35.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.877146  9577 leader_election.cc:336] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561): Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111)
02:12:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.882563  9444 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ff355b8c4e3498a99c3fe74b28ef3ec in term 2.
02:12:35.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.883301 10179 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:12:35.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.884049  9576 leader_election.cc:304] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb06e422fab4306a0f51858fdbedb8e, 6ff355b8c4e3498a99c3fe74b28ef3ec; no voters: 4973e141d9914d89902427b85a5f9c2e
02:12:35.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.885186 10180 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 2 FOLLOWER]: Leader election won for term 2
02:12:35.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.885710 10180 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [term 2 LEADER]: Becoming Leader. State: Replica: 6ff355b8c4e3498a99c3fe74b28ef3ec, State: Running, Role: LEADER
02:12:35.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.886583 10180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } }
02:12:35.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.890623 10177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ff355b8c4e3498a99c3fe74b28ef3ec. Latest consensus state: current_term: 2 leader_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:35.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.891348 10177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: This master's current role is: LEADER
02:12:35.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.893203 10187 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:35.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.899614 10187 catalog_manager.cc:679] Loaded metadata for table TestMasterFailover-killBefore=OPEN_TABLE [id=8b2a33188a544c1991baba6259406d0e]
02:12:35.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.905083 10187 tablet_loader.cc:96] loaded metadata for tablet d2e6de54b23143b9bd04bc1f3a342f66 (table TestMasterFailover-killBefore=OPEN_TABLE [id=8b2a33188a544c1991baba6259406d0e])
02:12:35.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.905993 10187 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:35.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.908499 10187 catalog_manager.cc:1295] Loaded cluster ID: 924ee198371e41a2b61aa0f623e8c561
02:12:35.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.908689 10187 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:35.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.911751 10187 catalog_manager.cc:1540] Loading token signing keys...
02:12:35.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.914280 10187 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec: Loaded TSK: 0
02:12:35.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.915225 10187 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:36.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.272966  9444 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [term 2 FOLLOWER]: Refusing update from remote peer 6ff355b8c4e3498a99c3fe74b28ef3ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:12:36.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.275312 10177 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
02:12:36.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.279942 10179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ff355b8c4e3498a99c3fe74b28ef3ec. Latest consensus state: current_term: 2 leader_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:36.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.280633 10179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: This master's current role is: FOLLOWER
02:12:36.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.285269 10179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:36.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.286114 10179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb06e422fab4306a0f51858fdbedb8e [sys.catalog]: This master's current role is: FOLLOWER
02:12:36.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.286479 10177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb06e422fab4306a0f51858fdbedb8e" member_type: VOTER last_known_addr { host: "127.9.43.190" port: 33113 } } peers { permanent_uuid: "4973e141d9914d89902427b85a5f9c2e" member_type: VOTER last_known_addr { host: "127.9.43.189" port: 38561 } } peers { permanent_uuid: "6ff355b8c4e3498a99c3fe74b28ef3ec" member_type: VOTER last_known_addr { host: "127.9.43.188" port: 41369 } } }
02:12:36.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.287191 10177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec [sys.catalog]: This master's current role is: LEADER
02:12:36.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:36.289170  9577 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6ff355b8c4e3498a99c3fe74b28ef3ec -> Peer 4973e141d9914d89902427b85a5f9c2e (127.9.43.189:38561): Couldn't send request to peer 4973e141d9914d89902427b85a5f9c2e. Status: Network error: Client connection negotiation failed: client connection to 127.9.43.189:38561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:12:36.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:36.879601 10105 debug-util.cc:398] Leaking SignalData structure 0x7b0800041100 after lost signal to thread 9980
02:12:36.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:36.880406 10105 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7fa0 after lost signal to thread 10108
02:12:36.960 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.43.189:38561(127.9.43.189:38561)] connecting to peer
02:12:36.961 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:36.962 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.43.189:38561(127.9.43.189:38561)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:36.962 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.43.189:38561: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561
02:12:36.968 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:36.979 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=50000, elapsed=2479), Traces: [0ms] sending RPC to server master-127.9.43.189:38561, [2ms] received response from server master-127.9.43.189:38561: Network error: connection closed, [2ms] delaying RPC due to: Network error: connection closed, [9ms] refreshing cache from master, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [11ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [16ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [16ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [18ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [21ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [30ms] refreshing cache from master, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [31ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [34ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [36ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [37ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [49ms] refreshing cache from master, [50ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [51ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [53ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [55ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [55ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [55ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [69ms] refreshing cache from master, [70ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [73ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [75ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [76ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [110ms] refreshing cache from master, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [111ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [113ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [115ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [115ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [116ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [169ms] refreshing cache from master, [170ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [171ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [172ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [175ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [175ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [175ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [309ms] refreshing cache from master, [310ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [311ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [320ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [321ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [324ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [325ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [469ms] refreshing cache from master, [470ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [471ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [471ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [473ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [474ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [475ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [475ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [489ms] refreshing cache from master, [490ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [490ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [491ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [491ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [494ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [494ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [495ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [809ms] refreshing cache from master, [810ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [811ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [811ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [812ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [814ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, [815ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.190:33113: OK, [815ms] delaying RPC due to: Service unavailable: Master config (127.9.43.189:38561,127.9.43.188:41369,127.9.43.190:33113) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [2470ms] refreshing cache from master, [2470ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.189:38561, [2472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.188:41369, [2473ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.43.190:33113, [2473ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.189:38561: Network error: Failed to connect to peer master-127.9.43.189:38561(127.9.43.189:38561): Connection refused: /127.9.43.189:38561, [2478ms] Sub RPC ConnectToMaster: received response from server master-127.9.43.188:41369: OK, deferred=Deferred@239184267(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$233/0x00007f591032cd50@102ff25c -> wakeup thread Time-limited test -> (continuation of Deferred@87822791 after retry RPC after error@1698105879) -> (continuation of Deferred@1715075787 after retry RPC after error@166418754) -> (continuation of Deferred@1824310161 after retry RPC after error@822479779) -> (continuation of Deferred@406864106 after retry RPC after error@1261583337) -> (continuation of Deferred@1100532053 after retry RPC after error@1086495190) -> (continuation of Deferred@1512035892 after retry RPC after error@11027437) -> (continuation of Deferred@125694156 after retry RPC after error@1403377116) -> (continuation of Deferred@2007963626 after retry RPC after error@895124953) -> (continuation of Deferred@1565124654 after retry RPC after error@549440878) -> (continuation of Deferred@799055572 after retry RPC after error@1312137908), errback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@87822791 after retry RPC after error@1698105879) -> (continuation of Deferred@1715075787 after retry RPC after error@166418754) -> (continuation of Deferred@1824310161 after retry RPC after error@822479779) -> (continuation of Deferred@406864106 after retry RPC after error@1261583337) -> (continuation of Deferred@1100532053 after retry RPC after error@1086495190) -> (continuation of Deferred@1512035892 after retry RPC after error@11027437) -> (continuation of Deferred@125694156 after retry RPC after error@1403377116) -> (continuation of Deferred@2007963626 after retry RPC after error@895124953) -> (continuation of Deferred@1565124654 after retry RPC after error@549440878) -> (continuation of Deferred@799055572 after retry RPC after error@1312137908))) after lookup
02:12:36.987 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 8b2a33188a544c1991baba6259406d0e
02:12:37.016 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d2e6de54b23143b9bd04bc1f3a342f66 for table 'TestMasterFailover-killBefore=OPEN_TABLE' with partition [<start>, <end>)
02:12:37.024 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299992, tablet=d2e6de54b23143b9bd04bc1f3a342f66@[0645fa9b096d44118e7346e52f19cdc7(127.9.43.129:33977),7eb694d3b9fa424f8372bc67ac2b0cc2(127.9.43.131:46163),a81bfc1d005a449289504a147841416a(127.9.43.130:41261)[L]]}]
02:12:37.034 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.43.188:41369, [10ms] Sub RPC GetTableLocations: received response from server master-127.9.43.188:41369: OK, deferred=null)) after lookup
02:12:37.048 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a81bfc1d005a449289504a147841416a(127.9.43.130:41261)] connecting to peer
02:12:37.049 [DEBUG - kudu-nio-6] (Connection.java:757) [peer a81bfc1d005a449289504a147841416a(127.9.43.130:41261)] Successfully connected to peer
02:12:37.174 [DEBUG - kudu-nio-6] (Negotiator.java:918) Authenticated connection [id: 0x86c2f61e, L:/127.0.0.1:50858 - R:/127.9.43.130:41261] using TOKEN/null
02:12:37.235 [DEBUG - kudu-nio-6] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=OPEN_TABLE, tablet=d2e6de54b23143b9bd04bc1f3a342f66, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:12:37.249 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:12:37.256 [DEBUG - main] (Connection.java:575) [peer a81bfc1d005a449289504a147841416a(127.9.43.130:41261)] disconnecting while in state READY
02:12:37.257 [DEBUG - main] (Connection.java:575) [peer master-127.9.43.189:38561(127.9.43.189:38561)] disconnecting while in state TERMINATED
02:12:37.258 [DEBUG - main] (Connection.java:575) [peer master-127.9.43.188:41369(127.9.43.188:41369)] disconnecting while in state READY
02:12:37.258 [DEBUG - main] (Connection.java:575) [peer master-127.9.43.190:33113(127.9.43.190:33113)] disconnecting while in state READY
02:12:37.260 [DEBUG - kudu-nio-6] (Connection.java:239) [peer a81bfc1d005a449289504a147841416a(127.9.43.130:41261)] handling channelInactive
02:12:37.260 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.43.190:33113(127.9.43.190:33113)] handling channelInactive
02:12:37.260 [DEBUG - kudu-nio-6] (Connection.java:709) [peer a81bfc1d005a449289504a147841416a(127.9.43.130:41261)] cleaning up while in state READY due to: connection closed
02:12:37.261 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.43.190:33113(127.9.43.190:33113)] cleaning up while in state READY due to: connection closed
02:12:37.261 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:12:37.262 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.43.188:41369(127.9.43.188:41369)] handling channelInactive
02:12:37.262 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.43.188:41369(127.9.43.188:41369)] cleaning up while in state READY due to: connection closed
02:12:37.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.264465  9390 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 9680
02:12:37.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.317699  9390 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 9837
02:12:37.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.358038  9390 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 9978
02:12:37.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.391065  9390 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 9402
02:12:37.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.418586  9390 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 9547
02:12:38.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:38Z chronyd exiting
.02:12:39.825 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783476759825
02:12:39.837 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:12:39.838 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:12:39.838 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskdJk2H7/test-tmp
02:12:39.838 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:12:39.839 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskdJk2H7/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:12:39.841 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:12:40.184 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:40.184 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:12:40.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.187592 10211 mini_oidc.cc:150] Starting JWKS server
02:12:40.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.191004 10211 webserver.cc:533] Webserver started at http://127.0.0.1:37631/ using document root <none> and password file <none>
02:12:40.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.191459 10211 mini_oidc.cc:186] Starting OIDC Discovery server
02:12:40.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.193109 10211 webserver.cc:533] Webserver started at http://127.0.0.1:37103/ using document root <none> and password file <none>
02:12:40.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:12:40.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:40Z Disabled control of system clock
02:12:40.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.257416 10211 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/logs
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data/info.pb
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.254:46883
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.254
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:40.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:40.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:40.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:40.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:40.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37631/jwks.json with env {}
02:12:40.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.562306 10223 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:40.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.563062 10223 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:40.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.563706 10223 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:40.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.596760 10223 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:40.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.597160 10223 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:40.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.597575 10223 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:40.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.597960 10223 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:40.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.598297 10223 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:40.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.598548 10223 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37631/jwks.json
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.636547 10223 master_runner.cc:387] Master server non-default flags:
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.254:46883
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:40.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37631/jwks.json
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data/info.pb
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.254
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/logs
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:40.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.638410 10223 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:40.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.640220 10223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:41.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.652046 10230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:41.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.652046 10229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:41.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:41.875649 10232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:41.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:41.879315 10223 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.227s	user 0.345s	sys 0.881s
02:12:41.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:41.879449 10231 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1221 milliseconds
02:12:41.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:41.879619 10223 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.228s	user 0.345s	sys 0.881s
02:12:41.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.879937 10223 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:41.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.881784 10223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:41.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.884482 10223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:41.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.885905 10223 hybrid_clock.cc:648] HybridClock initialized: now 1783476761885852 us; error 62 us; skew 500 ppm
02:12:41.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.886776 10223 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:41.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.894371 10223 webserver.cc:533] Webserver started at http://127.9.248.254:44419/ using document root <none> and password file <none>
02:12:41.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.895460 10223 fs_manager.cc:362] Metadata directory not provided
02:12:41.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.895717 10223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:41.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.896279 10223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:41.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.900599 10223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data/instance:
02:12:41.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f6107bf23d3845a5a55485c384d093dd"
02:12:41.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:41 on dist-test-slave-3kxw"
02:12:41.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.901854 10223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal/instance:
02:12:41.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f6107bf23d3845a5a55485c384d093dd"
02:12:41.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:41 on dist-test-slave-3kxw"
02:12:41.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.910028 10223 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.005s
02:12:41.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.916366 10239 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:41.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.917675 10223 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
02:12:41.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.918116 10223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal
02:12:41.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f6107bf23d3845a5a55485c384d093dd"
02:12:41.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:41 on dist-test-slave-3kxw"
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.918507 10223 fs_report.cc:389] FS layout report
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data/data
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:41.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:41.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:41.998457 10223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:42.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.000101 10223 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:42.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.000676 10223 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:42.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.072906 10223 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.254:46883
02:12:42.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.072986 10290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.254:46883 every 8 connection(s)
02:12:42.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.075747 10223 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/data/info.pb
02:12:42.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.081528 10291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:42.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.086330 10211 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 10223
02:12:42.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.086721 10211 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-0/wal/instance
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.090023 10211 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/logs
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data/info.pb
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:42.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.253:39169
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.253
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:42.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:42.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37631/jwks.json with env {}
02:12:42.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.092825 10291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } has no permanent_uuid. Determining permanent_uuid...
02:12:42.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.127696 10291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } has no permanent_uuid. Determining permanent_uuid...
02:12:42.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.130502 10240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:42.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.135092 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:42.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.184689 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 1
02:12:42.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.189420 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:42.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.257875 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 2
02:12:42.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.262149 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:42.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.353672 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 3
02:12:42.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.357892 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:42.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.419049 10293 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:42.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.419618 10293 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:42.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.420081 10293 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:42.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.453697 10293 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:42.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.454057 10293 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:42.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.454262 10293 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:42.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.454476 10293 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:42.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.454663 10293 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:42.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.454813 10293 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37631/jwks.json
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.492110 10293 master_runner.cc:387] Master server non-default flags:
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:42.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.253:39169
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37631/jwks.json
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data/info.pb
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.253
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:42.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/logs
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:42.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.493505 10293 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:42.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.495292 10293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:42.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.501405 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 4
02:12:42.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.508134 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:42.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.508064 10302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:42.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:42.807646 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 5
02:12:42.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.812650 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:43.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.360299 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 6
02:12:43.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.368943 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.253:39169: Network error: Client connection negotiation failed: client connection to 127.9.248.253:39169: connect: Connection refused (error 111)
02:12:43.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.510530 10303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:43.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:42.512121 10305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:43.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.710899 10304 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:12:43.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.710963 10293 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:43.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.715483 10293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:43.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.718237 10293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:43.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.719619 10293 hybrid_clock.cc:648] HybridClock initialized: now 1783476763719589 us; error 50 us; skew 500 ppm
02:12:43.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.720486 10293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:43.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.726794 10293 webserver.cc:533] Webserver started at http://127.9.248.253:39661/ using document root <none> and password file <none>
02:12:43.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.727800 10293 fs_manager.cc:362] Metadata directory not provided
02:12:43.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.728048 10293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:43.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.728617 10293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:43.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.733021 10293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data/instance:
02:12:43.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fd7fc2a0682b4a429ff0cf32764d7331"
02:12:43.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:43 on dist-test-slave-3kxw"
02:12:43.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.734329 10293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal/instance:
02:12:43.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fd7fc2a0682b4a429ff0cf32764d7331"
02:12:43.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:43 on dist-test-slave-3kxw"
02:12:43.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.742259 10293 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
02:12:43.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.748075 10314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:43.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.749146 10293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.749544 10293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fd7fc2a0682b4a429ff0cf32764d7331"
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:43 on dist-test-slave-3kxw"
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.750015 10293 fs_report.cc:389] FS layout report
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data/data
02:12:43.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:43.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:43.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.821318 10293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:43.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.822952 10293 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:43.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.823500 10293 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.894666 10293 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.253:39169
02:12:43.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.894755 10366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.253:39169 every 8 connection(s)
02:12:43.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.897615 10293 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/data/info.pb
02:12:43.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.902951 10211 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 10293
02:12:43.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.903295 10211 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-1/wal/instance
02:12:43.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.903656 10367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.905218 10211 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:43.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/logs
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data/info.pb
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.252:36505
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.252
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:43.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:43.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37631/jwks.json with env {}
02:12:43.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.915508 10367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } has no permanent_uuid. Determining permanent_uuid...
02:12:43.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.937589 10367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } has no permanent_uuid. Determining permanent_uuid...
02:12:43.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.952606 10367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } has no permanent_uuid. Determining permanent_uuid...
02:12:43.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.955129 10315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:43.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.959903 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.009455 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 1
02:12:44.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.014905 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.083376 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 2
02:12:44.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.088712 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.180176 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 3
02:12:44.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.184913 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.227238 10369 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:44.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.227974 10369 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:44.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.228633 10369 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:44.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.261796 10369 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:44.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.262213 10369 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:44.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.262619 10369 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:44.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.262982 10369 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:44.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.263303 10369 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:44.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.263592 10369 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37631/jwks.json
02:12:44.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.301292 10369 master_runner.cc:387] Master server non-default flags:
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.252:36505
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37631/jwks.json
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data/info.pb
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.252
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:44.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/logs
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:44.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.303135 10369 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:44.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.304911 10369 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:44.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.316629 10380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:44.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.328333 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 4
02:12:44.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.333101 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.429620 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } attempt: 7
02:12:44.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.443140 10291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } has no permanent_uuid. Determining permanent_uuid...
02:12:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.449106 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.507761 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 1
02:12:44.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.512977 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.594456 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 2
02:12:44.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.599902 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.632582 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 5
02:12:44.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.639014 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.685325 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 3
02:12:44.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.691313 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:44.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.831781 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 4
02:12:44.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.837738 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:45.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.121290 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 5
02:12:45.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.127692 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:45.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.186542 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 6
02:12:45.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.194859 10367 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:45.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.316645 10379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:45.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.541455 10381 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:12:45.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.542922 10382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:45.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.542948 10369 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:45.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.546079 10369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:45.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.548739 10369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:45.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.550132 10369 hybrid_clock.cc:648] HybridClock initialized: now 1783476765550083 us; error 42 us; skew 500 ppm
02:12:45.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.551146 10369 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:45.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.557631 10369 webserver.cc:533] Webserver started at http://127.9.248.252:40453/ using document root <none> and password file <none>
02:12:45.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.558686 10369 fs_manager.cc:362] Metadata directory not provided
02:12:45.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.558951 10369 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:45.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.559516 10369 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:45.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.563974 10369 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data/instance:
02:12:45.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04cbb8f84fcd42f483f6a551ec5235c3"
02:12:45.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:45 on dist-test-slave-3kxw"
02:12:45.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.565243 10369 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal/instance:
02:12:45.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04cbb8f84fcd42f483f6a551ec5235c3"
02:12:45.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:45 on dist-test-slave-3kxw"
02:12:45.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.573215 10369 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
02:12:45.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.579095 10393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:45.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.580367 10369 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.580763 10369 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04cbb8f84fcd42f483f6a551ec5235c3"
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:45 on dist-test-slave-3kxw"
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.581173 10369 fs_report.cc:389] FS layout report
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal
02:12:45.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data/data
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:45.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:45.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.639070 10369 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:45.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.640722 10369 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:45.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.641294 10369 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:45.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.680179 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 6
02:12:45.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.688385 10291 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.9.248.252:36505: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:45.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.716383 10369 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.252:36505
02:12:45.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.716466 10446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.252:36505 every 8 connection(s)
02:12:45.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.719198 10369 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/data/info.pb
02:12:45.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.724649 10211 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 10369
02:12:45.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.725138 10211 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/master-2/wal/instance
02:12:45.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.725523 10447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:45.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.742926 10447 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } has no permanent_uuid. Determining permanent_uuid...
02:12:45.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.767668 10447 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } has no permanent_uuid. Determining permanent_uuid...
02:12:45.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.778056 10447 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } has no permanent_uuid. Determining permanent_uuid...
02:12:45.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.794811 10447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: Bootstrap starting.
02:12:45.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.801685 10447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: Neither blocks nor log segments found. Creating new log.
02:12:45.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.803465 10447 log.cc:826] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: Log is configured to *not* fsync() on all Append() calls
02:12:45.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.808741 10447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: No bootstrap required, opened a new log
02:12:45.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.827260 10447 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:45.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.828421 10447 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:45.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.828971 10447 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04cbb8f84fcd42f483f6a551ec5235c3, State: Initialized, Role: FOLLOWER
02:12:45.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.829881 10447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:45.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.832176 10456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:45.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.832813 10456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: This master's current role is: FOLLOWER
02:12:45.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.833516 10447 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: configured and running, proceeding with master startup.
02:12:45.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.859916 10467 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:12:45.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.860294 10467 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:12:45.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.854935 10369 master_runner.cc:187] Error getting master registration for 127.9.248.254:46883: OK, instance_id { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" instance_seqno: 1783476762053148 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:45.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.877465 10369 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:45.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.896731 10399 tablet.cc:2406] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:46.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.155184 10456 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:46.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.155742 10456 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.157963 10456 leader_election.cc:290] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6107bf23d3845a5a55485c384d093dd (127.9.248.254:46883), fd7fc2a0682b4a429ff0cf32764d7331 (127.9.248.253:39169)
02:12:46.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.255496 10367 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 7
02:12:46.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.279075 10367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: Bootstrap starting.
02:12:46.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.286653 10367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: Neither blocks nor log segments found. Creating new log.
02:12:46.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.289341 10367 log.cc:826] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: Log is configured to *not* fsync() on all Append() calls
02:12:46.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.295310 10367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: No bootstrap required, opened a new log
02:12:46.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.323105 10367 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.323968 10367 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:46.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.324265 10367 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7fc2a0682b4a429ff0cf32764d7331, State: Initialized, Role: FOLLOWER
02:12:46.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.325277 10367 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.328313 10471 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:46.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.329377 10471 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: This master's current role is: FOLLOWER
02:12:46.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.330080 10367 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: configured and running, proceeding with master startup.
02:12:46.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.330320 10342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" is_pre_election: true
02:12:46.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.331136 10320 tablet.cc:2406] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:46.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.331357 10342 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04cbb8f84fcd42f483f6a551ec5235c3 in term 0.
02:12:46.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.333194 10394 leader_election.cc:304] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04cbb8f84fcd42f483f6a551ec5235c3, fd7fc2a0682b4a429ff0cf32764d7331; no voters: 
02:12:46.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.333979 10456 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:46.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.334332 10456 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:46.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.334672 10456 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 0 FOLLOWER]: Advancing to term 1
02:12:46.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.341905 10456 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.346772 10456 leader_election.cc:290] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [CANDIDATE]: Term 1 election: Requested vote from peers f6107bf23d3845a5a55485c384d093dd (127.9.248.254:46883), fd7fc2a0682b4a429ff0cf32764d7331 (127.9.248.253:39169)
02:12:46.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.347383 10342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd7fc2a0682b4a429ff0cf32764d7331"
02:12:46.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.348001 10342 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 0 FOLLOWER]: Advancing to term 1
02:12:46.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.359583 10342 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04cbb8f84fcd42f483f6a551ec5235c3 in term 1.
02:12:46.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.360744 10394 leader_election.cc:304] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04cbb8f84fcd42f483f6a551ec5235c3, fd7fc2a0682b4a429ff0cf32764d7331; no voters: 
02:12:46.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.361644 10456 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 1 FOLLOWER]: Leader election won for term 1
02:12:46.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.363648 10456 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [term 1 LEADER]: Becoming Leader. State: Replica: 04cbb8f84fcd42f483f6a551ec5235c3, State: Running, Role: LEADER
02:12:46.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.364650 10456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.372241 10476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04cbb8f84fcd42f483f6a551ec5235c3. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:46.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.373561 10476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: This master's current role is: LEADER
02:12:46.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.378219 10478 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:46.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.385861 10478 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:46.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.406864 10342 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Refusing update from remote peer 04cbb8f84fcd42f483f6a551ec5235c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:46.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.408751 10456 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.439502 10471 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04cbb8f84fcd42f483f6a551ec5235c3. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.440712 10471 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: This master's current role is: FOLLOWER
02:12:46.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.449415 10481 mvcc.cc:204] Tried to move back new op lower bound from 7305120835181682688 to 7305120835039617024. Current Snapshot: MvccSnapshot[applied={T|T < 7305120835181682688}]
02:12:46.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.458822 10476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:46.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.459607 10476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: This master's current role is: LEADER
02:12:46.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.461465 10478 catalog_manager.cc:1383] Generated new cluster ID: f3eea57f0c6c40a3bcdbd6cb38f47f7f
02:12:46.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.461781 10478 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:46.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.467685 10489 catalog_manager.cc:1594] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:12:46.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.468076 10489 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:12:46.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.478796 10471 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:46.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.483417 10471 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: This master's current role is: FOLLOWER
02:12:46.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.452440 10293 master_runner.cc:187] Error getting master registration for 127.9.248.254:46883: OK, instance_id { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" instance_seqno: 1783476762053148 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:46.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.519846 10293 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:46.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.530025 10478 catalog_manager.cc:1406] Generated new certificate authority record
02:12:46.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.532348 10478 catalog_manager.cc:1540] Loading token signing keys...
02:12:46.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.556666 10478 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3: Generated new TSK 0
02:12:46.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.561061 10478 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:46.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.617475 10211 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/logs
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data/info.pb
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.193:0
02:12:46.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.193
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.193
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:46.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:46.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.721827 10291 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } attempt: 7
02:12:46.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.782840 10291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: Bootstrap starting.
02:12:46.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.792502 10291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: Neither blocks nor log segments found. Creating new log.
02:12:46.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.796030 10291 log.cc:826] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: Log is configured to *not* fsync() on all Append() calls
02:12:46.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.821228 10291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: No bootstrap required, opened a new log
02:12:46.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.880016 10291 raft_consensus.cc:359] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.892938 10291 raft_consensus.cc:385] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:46.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.894109 10291 raft_consensus.cc:740] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6107bf23d3845a5a55485c384d093dd, State: Initialized, Role: FOLLOWER
02:12:46.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.895565 10291 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:46.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.927453 10496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:46.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.928946 10496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: This master's current role is: FOLLOWER
02:12:46.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.929634 10291 sys_catalog.cc:565] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: configured and running, proceeding with master startup.
02:12:46.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.929872 10265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6107bf23d3845a5a55485c384d093dd"
02:12:46.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.930955 10264 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 0 FOLLOWER]: Advancing to term 1
02:12:46.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.929790 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6107bf23d3845a5a55485c384d093dd" is_pre_election: true
02:12:46.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.940331 10264 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 1 FOLLOWER]: Refusing update from remote peer 04cbb8f84fcd42f483f6a551ec5235c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:46.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.942469 10476 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:47.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.009341 10496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04cbb8f84fcd42f483f6a551ec5235c3. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:47.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.013043 10496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: This master's current role is: FOLLOWER
02:12:47.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.015039 10504 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:47.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.022897 10504 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: This master's current role is: FOLLOWER
02:12:47.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.084710 10512 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:12:47.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.290503 10493 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:47.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.291162 10493 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:47.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.291884 10493 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.353440 10493 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:47.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.354867 10493 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.248.193
02:12:47.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.423120 10493 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:47.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.193:0
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data/info.pb
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.193
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.193
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/logs
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.424959 10493 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:47.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.427268 10493 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:47.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.444187 10518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:47.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.475544 10489 catalog_manager.cc:1295] Loaded cluster ID: f3eea57f0c6c40a3bcdbd6cb38f47f7f
02:12:47.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.475961 10489 catalog_manager.cc:1588] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: loading cluster ID for follower catalog manager: success
02:12:47.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.488477 10489 catalog_manager.cc:1610] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: acquiring CA information for follower catalog manager: success
02:12:47.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.504501 10489 catalog_manager.cc:1638] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:47.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.592453 10476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:47.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.594142 10476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04cbb8f84fcd42f483f6a551ec5235c3 [sys.catalog]: This master's current role is: LEADER
02:12:48.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.106940 10512 catalog_manager.cc:1295] Loaded cluster ID: f3eea57f0c6c40a3bcdbd6cb38f47f7f
02:12:48.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.107566 10512 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: loading cluster ID for follower catalog manager: success
02:12:48.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.120162 10512 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: acquiring CA information for follower catalog manager: success
02:12:48.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.131501 10512 catalog_manager.cc:1638] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:48.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.845774 10517 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 10493
02:12:48.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.958204 10493 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.509s	user 0.525s	sys 0.836s
02:12:48.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.961644 10493 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.513s	user 0.525s	sys 0.836s
02:12:48.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.451030 10519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:48.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.976310 10493 server_base.cc:1061] running on GCE node
02:12:48.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.976289 10526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:48.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.978147 10493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:48.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.988858 10493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:48.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.990779 10493 hybrid_clock.cc:648] HybridClock initialized: now 1783476768990737 us; error 62 us; skew 500 ppm
02:12:48.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.991931 10493 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:49.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.019963 10493 webserver.cc:533] Webserver started at http://127.9.248.193:42357/ using document root <none> and password file <none>
02:12:49.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.021317 10493 fs_manager.cc:362] Metadata directory not provided
02:12:49.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.021625 10493 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:49.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.022264 10493 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:49.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.028699 10493 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data/instance:
02:12:49.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9d359dfee52d432faab9a8e31b5aad9e"
02:12:49.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3kxw"
02:12:49.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.030344 10493 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal/instance:
02:12:49.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9d359dfee52d432faab9a8e31b5aad9e"
02:12:49.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3kxw"
02:12:49.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.055266 10493 fs_manager.cc:696] Time spent creating directory manager: real 0.024s	user 0.014s	sys 0.010s
02:12:49.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.069308 10531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:49.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.070744 10493 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.009s	sys 0.001s
02:12:49.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.071174 10493 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal
02:12:49.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9d359dfee52d432faab9a8e31b5aad9e"
02:12:49.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3kxw"
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.071614 10493 fs_report.cc:389] FS layout report
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data/data
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:49.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:49.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:49.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.162147 10493 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:49.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.164160 10493 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:49.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.164815 10493 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:49.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.168648 10493 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:49.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.174786 10493 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:49.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.175078 10493 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:49.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.175374 10493 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:49.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.175585 10493 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:49.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.402494 10493 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.193:33969
02:12:49.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.402638 10644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.193:33969 every 8 connection(s)
02:12:49.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.406243 10493 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/data/info.pb
02:12:49.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.409299 10211 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 10493
02:12:49.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.409785 10211 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-0/wal/instance
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.424153 10211 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/logs
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data/info.pb
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.194:0
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.194
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.194
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:49.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:49.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.454720 10645 heartbeater.cc:344] Connected to a master server at 127.9.248.252:36505
02:12:49.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.455341 10645 heartbeater.cc:461] Registering TS with master...
02:12:49.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.458117 10645 heartbeater.cc:507] Master 127.9.248.252:36505 requested a full tablet report, sending...
02:12:49.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.462638 10410 ts_manager.cc:194] Registered new tserver with Master: 9d359dfee52d432faab9a8e31b5aad9e (127.9.248.193:33969)
02:12:49.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.465329 10410 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.248.193:53037
02:12:49.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.477831 10648 heartbeater.cc:344] Connected to a master server at 127.9.248.253:39169
02:12:49.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.478288 10648 heartbeater.cc:461] Registering TS with master...
02:12:49.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.479140 10648 heartbeater.cc:507] Master 127.9.248.253:39169 requested a full tablet report, sending...
02:12:49.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.482893 10331 ts_manager.cc:194] Registered new tserver with Master: 9d359dfee52d432faab9a8e31b5aad9e (127.9.248.193:33969)
02:12:49.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.488584 10653 heartbeater.cc:344] Connected to a master server at 127.9.248.254:46883
02:12:49.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.489002 10653 heartbeater.cc:461] Registering TS with master...
02:12:49.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.489720 10653 heartbeater.cc:507] Master 127.9.248.254:46883 requested a full tablet report, sending...
02:12:49.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.493098 10255 ts_manager.cc:194] Registered new tserver with Master: 9d359dfee52d432faab9a8e31b5aad9e (127.9.248.193:33969)
02:12:49.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.947093 10650 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:49.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.947738 10650 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.948439 10650 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:50.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.009099 10650 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:50.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.011008 10650 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.248.194
02:12:50.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.079334 10650 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:50.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.194:0
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data/info.pb
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.194
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.194
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/logs
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:50.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:50.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:50.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:50.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.084347 10650 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:50.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.087112 10650 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.122563 10661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:50.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.470865 10645 heartbeater.cc:499] Master 127.9.248.252:36505 was elected leader, sending a full tablet report...
02:12:51.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.133877 10662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:51.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.517078 10660 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 10650
02:12:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.717859 10660 kernel_stack_watchdog.cc:198] Thread 10650 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 384ms:
02:12:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:12:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:12:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:12:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:12:51.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.718395 10650 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.588s	user 0.583s	sys 1.001s
02:12:51.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.718729 10650 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.589s	user 0.583s	sys 1.001s
02:12:51.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.728994 10650 server_base.cc:1061] running on GCE node
02:12:51.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.730795 10669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:51.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.732409 10650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:51.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.735134 10650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:51.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.736833 10650 hybrid_clock.cc:648] HybridClock initialized: now 1783476771736722 us; error 118 us; skew 500 ppm
02:12:51.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.738099 10650 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:51.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.746419 10650 webserver.cc:533] Webserver started at http://127.9.248.194:41303/ using document root <none> and password file <none>
02:12:51.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.747957 10650 fs_manager.cc:362] Metadata directory not provided
02:12:51.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.748500 10650 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.749188 10650 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.755582 10650 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data/instance:
02:12:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4f2607cc7bca43c79b7ef44968880f26"
02:12:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:51 on dist-test-slave-3kxw"
02:12:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.757501 10650 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal/instance:
02:12:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4f2607cc7bca43c79b7ef44968880f26"
02:12:51.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:51 on dist-test-slave-3kxw"
02:12:51.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.767818 10650 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.008s	sys 0.000s
02:12:51.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.774412 10674 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.775804 10650 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
02:12:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.776222 10650 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal
02:12:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4f2607cc7bca43c79b7ef44968880f26"
02:12:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:51 on dist-test-slave-3kxw"
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.776644 10650 fs_report.cc:389] FS layout report
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data/data
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:51.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:51.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.872942 10650 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:51.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.874517 10650 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:51.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.874928 10650 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:51.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.878262 10650 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:51.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.883249 10650 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:51.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.883464 10650 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:51.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.883661 10650 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:51.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.883785 10650 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:52.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.030488 10650 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.194:36261
02:12:52.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.030596 10787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.194:36261 every 8 connection(s)
02:12:52.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.033089 10650 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/data/info.pb
02:12:52.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.040715 10211 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 10650
02:12:52.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.041553 10211 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-1/wal/instance
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.065805 10211 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:52.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/logs
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data/info.pb
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:52.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.195:0
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.195
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.195
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:52.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.084584 10788 heartbeater.cc:344] Connected to a master server at 127.9.248.252:36505
02:12:52.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.085103 10788 heartbeater.cc:461] Registering TS with master...
02:12:52.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.086535 10788 heartbeater.cc:507] Master 127.9.248.252:36505 requested a full tablet report, sending...
02:12:52.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.088129 10789 heartbeater.cc:344] Connected to a master server at 127.9.248.253:39169
02:12:52.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.088480 10789 heartbeater.cc:461] Registering TS with master...
02:12:52.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.089401 10789 heartbeater.cc:507] Master 127.9.248.253:39169 requested a full tablet report, sending...
02:12:52.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.090339 10410 ts_manager.cc:194] Registered new tserver with Master: 4f2607cc7bca43c79b7ef44968880f26 (127.9.248.194:36261)
02:12:52.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.092180 10410 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.248.194:46321
02:12:52.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.096932 10331 ts_manager.cc:194] Registered new tserver with Master: 4f2607cc7bca43c79b7ef44968880f26 (127.9.248.194:36261)
02:12:52.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.097716 10790 heartbeater.cc:344] Connected to a master server at 127.9.248.254:46883
02:12:52.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.098125 10790 heartbeater.cc:461] Registering TS with master...
02:12:52.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.099104 10790 heartbeater.cc:507] Master 127.9.248.254:46883 requested a full tablet report, sending...
02:12:52.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.102607 10255 ts_manager.cc:194] Registered new tserver with Master: 4f2607cc7bca43c79b7ef44968880f26 (127.9.248.194:36261)
02:12:52.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.420712 10798 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:52.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.421201 10798 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:52.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.421615 10798 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:52.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.455340 10798 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:52.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.456146 10798 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.248.195
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.493554 10798 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.248.212:42951
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.248.195:0
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data/info.pb
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.248.195
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:52.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.248.195
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/logs
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:52.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.494885 10798 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:52.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.496667 10798 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:52.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.512079 10805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:53.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.103936 10788 heartbeater.cc:499] Master 127.9.248.252:36505 was elected leader, sending a full tablet report...
02:12:54.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:53.915236 10804 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 10798
02:12:54.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.513672 10806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:54.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.348652 10798 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.836s	user 0.635s	sys 1.185s
02:12:54.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.350113 10798 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.838s	user 0.635s	sys 1.185s
02:12:54.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.351671 10808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:54.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.354785 10807 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1836 milliseconds
02:12:54.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.354820 10798 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:54.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.356081 10798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:54.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.358368 10798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:54.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.359751 10798 hybrid_clock.cc:648] HybridClock initialized: now 1783476774359709 us; error 65 us; skew 500 ppm
02:12:54.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.360582 10798 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:54.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.367020 10798 webserver.cc:533] Webserver started at http://127.9.248.195:38293/ using document root <none> and password file <none>
02:12:54.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.367959 10798 fs_manager.cc:362] Metadata directory not provided
02:12:54.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.368165 10798 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:54.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.368577 10798 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:54.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.373179 10798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data/instance:
02:12:54.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95db5c8a909c44778c6166aa566d2ae6"
02:12:54.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:54 on dist-test-slave-3kxw"
02:12:54.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.374339 10798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal/instance:
02:12:54.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95db5c8a909c44778c6166aa566d2ae6"
02:12:54.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:54 on dist-test-slave-3kxw"
02:12:54.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.382028 10798 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
02:12:54.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.389046 10816 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:54.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.390749 10798 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
02:12:54.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.391180 10798 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal
02:12:54.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "95db5c8a909c44778c6166aa566d2ae6"
02:12:54.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:54 on dist-test-slave-3kxw"
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.391506 10798 fs_report.cc:389] FS layout report
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data/data
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:54.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:54.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.444903 10798 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:54.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.446557 10798 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:54.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.447026 10798 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:54.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.449678 10798 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:54.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.454139 10798 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:54.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.454356 10798 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:54.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.454550 10798 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:54.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.454681 10798 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:54.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.600324 10798 rpc_server.cc:307] RPC server started. Bound to: 127.9.248.195:37675
02:12:54.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.600457 10929 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.248.195:37675 every 8 connection(s)
02:12:54.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.602919 10798 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/data/info.pb
02:12:54.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.606005 10211 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 10798
02:12:54.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.606493 10211 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster17648525315184111650/ts-2/wal/instance
02:12:54.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.670473 10931 heartbeater.cc:344] Connected to a master server at 127.9.248.253:39169
02:12:54.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.670996 10931 heartbeater.cc:461] Registering TS with master...
02:12:54.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.672425 10931 heartbeater.cc:507] Master 127.9.248.253:39169 requested a full tablet report, sending...
02:12:54.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.673254 10930 heartbeater.cc:344] Connected to a master server at 127.9.248.252:36505
02:12:54.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.673619 10930 heartbeater.cc:461] Registering TS with master...
02:12:54.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.674559 10930 heartbeater.cc:507] Master 127.9.248.252:36505 requested a full tablet report, sending...
02:12:54.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.675778 10331 ts_manager.cc:194] Registered new tserver with Master: 95db5c8a909c44778c6166aa566d2ae6 (127.9.248.195:37675)
02:12:54.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.677364 10932 heartbeater.cc:344] Connected to a master server at 127.9.248.254:46883
02:12:54.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.677306 10410 ts_manager.cc:194] Registered new tserver with Master: 95db5c8a909c44778c6166aa566d2ae6 (127.9.248.195:37675)
02:12:54.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.677680 10932 heartbeater.cc:461] Registering TS with master...
02:12:54.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.678591 10932 heartbeater.cc:507] Master 127.9.248.254:46883 requested a full tablet report, sending...
02:12:54.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.679327 10410 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.248.195:43135
02:12:54.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.682133 10255 ts_manager.cc:194] Registered new tserver with Master: 95db5c8a909c44778c6166aa566d2ae6 (127.9.248.195:37675)
02:12:54.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.685084 10211 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:12:54.696 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:54.697 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:12:54.700 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.248.254"
      port: 46883
    }
    bound_http_address {
      host: "127.9.248.254"
      port: 44419
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.248.253"
      port: 39169
    }
    bound_http_address {
      host: "127.9.248.253"
      port: 39661
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.248.252"
      port: 36505
    }
    bound_http_address {
      host: "127.9.248.252"
      port: 40453
    }
  }
}

02:12:54.700 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:12:54.701 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.248.193"
      port: 33969
    }
    bound_http_address {
      host: "127.9.248.193"
      port: 42357
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.248.194"
      port: 36261
    }
    bound_http_address {
      host: "127.9.248.194"
      port: 41303
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.248.195"
      port: 37675
    }
    bound_http_address {
      host: "127.9.248.195"
      port: 38293
    }
  }
}

02:12:54.701 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:12:54.704 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:12:54.706 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.248.254:46883(127.9.248.254:46883)] connecting to peer
02:12:54.707 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.248.253:39169(127.9.248.253:39169)] connecting to peer
02:12:54.709 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.710 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.248.254:46883(127.9.248.254:46883)] Successfully connected to peer
02:12:54.711 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.248.253:39169(127.9.248.253:39169)] Successfully connected to peer
02:12:54.716 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.9.248.252:36505(127.9.248.252:36505)] Successfully connected to peer
02:12:54.718 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.9.248.254
02:12:54.716 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.9.248.253
02:12:54.724 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.9.248.252
02:12:54.750 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xef0265f4, L:/127.0.0.1:51778 - R:/127.9.248.254:46883] using SASL/PLAIN
02:12:54.758 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x3b588855, L:/127.0.0.1:37394 - R:/127.9.248.252:36505] using SASL/PLAIN
02:12:54.759 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x4fba8bd8, L:/127.0.0.1:35126 - R:/127.9.248.253:39169] using SASL/PLAIN
02:12:54.762 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:54.763 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=58), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [49ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: OK, deferred=null) after lookup
02:12:54.783 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.9.248.252:36505
02:12:54.784 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:12:54.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.784708 10211 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 10369
02:12:54.819 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.9.248.252:36505(127.9.248.252:36505)] handling channelInactive
02:12:54.819 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state READY due to: connection closed
02:12:54.822 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:12:54.825 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:12:54.829 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.832 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.840 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.841 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.9.248.252:36505(127.9.248.252:36505) for tablet Kudu Master: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.846 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.849 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.850 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.850 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.851 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:54.867 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.869 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.869 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.870 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.871 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:54.887 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.890 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.890 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.890 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.891 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:54.906 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.909 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.909 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.909 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.910 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:54.927 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.928 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.929 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.929 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.931 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:54.947 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.948 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.951 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:54.966 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:54.968 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.968 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.968 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:54.970 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:55.027 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:55.029 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:55.030 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:55.030 [INFO - pool-6-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:55.033 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:55.108 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:55.110 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:55.110 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:55.110 [INFO - pool-6-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:55.111 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:55.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:55.129670 10788 heartbeater.cc:646] Failed to heartbeat to 127.9.248.252:36505 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:55.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:55.500326 10645 heartbeater.cc:646] Failed to heartbeat to 127.9.248.252:36505 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:55.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:55.683732 10930 heartbeater.cc:499] Master 127.9.248.252:36505 was elected leader, sending a full tablet report...
02:12:55.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:55.687937 10930 heartbeater.cc:646] Failed to heartbeat to 127.9.248.252:36505 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:56.047 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:56.048 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:56.048 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:56.049 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:56.050 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505; will retry
02:12:56.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.052472 10954 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04cbb8f84fcd42f483f6a551ec5235c3)
02:12:56.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.052985 10954 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.055060 10954 leader_election.cc:290] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6107bf23d3845a5a55485c384d093dd (127.9.248.254:46883), 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505)
02:12:56.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.056175 10264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6107bf23d3845a5a55485c384d093dd" is_pre_election: true
02:12:56.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.057487 10315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111) [suppressed 6 similar messages]
02:12:56.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.061153 10315 leader_election.cc:336] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505): Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:56.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.061478 10315 leader_election.cc:304] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd7fc2a0682b4a429ff0cf32764d7331; no voters: 04cbb8f84fcd42f483f6a551ec5235c3, f6107bf23d3845a5a55485c384d093dd
02:12:56.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.062136 10954 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:12:56.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.264662 10958 raft_consensus.cc:493] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04cbb8f84fcd42f483f6a551ec5235c3)
02:12:56.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.265283 10958 raft_consensus.cc:515] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:56.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.267347 10958 leader_election.cc:290] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fd7fc2a0682b4a429ff0cf32764d7331 (127.9.248.253:39169), 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505)
02:12:56.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.268435 10342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f6107bf23d3845a5a55485c384d093dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" is_pre_election: true
02:12:56.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.269418 10342 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6107bf23d3845a5a55485c384d093dd in term 1.
02:12:56.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.270784 10240 leader_election.cc:304] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6107bf23d3845a5a55485c384d093dd, fd7fc2a0682b4a429ff0cf32764d7331; no voters: 
02:12:56.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.271441 10240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111) [suppressed 13 similar messages]
02:12:56.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.271453 10958 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 1 FOLLOWER]: Leader pre-election won for term 2
02:12:56.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.271888 10958 raft_consensus.cc:493] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04cbb8f84fcd42f483f6a551ec5235c3)
02:12:56.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.272222 10958 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 1 FOLLOWER]: Advancing to term 2
02:12:56.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.275096 10240 leader_election.cc:336] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505): Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:56.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.278292 10958 raft_consensus.cc:515] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:56.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.280040 10958 leader_election.cc:290] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [CANDIDATE]: Term 2 election: Requested vote from peers fd7fc2a0682b4a429ff0cf32764d7331 (127.9.248.253:39169), 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505)
02:12:56.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.280779 10342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f6107bf23d3845a5a55485c384d093dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fd7fc2a0682b4a429ff0cf32764d7331"
02:12:56.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.281250 10342 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 1 FOLLOWER]: Advancing to term 2
02:12:56.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.283921 10240 leader_election.cc:336] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505): Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111)
02:12:56.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.287560 10342 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6107bf23d3845a5a55485c384d093dd in term 2.
02:12:56.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.288627 10240 leader_election.cc:304] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f6107bf23d3845a5a55485c384d093dd, fd7fc2a0682b4a429ff0cf32764d7331; no voters: 04cbb8f84fcd42f483f6a551ec5235c3
02:12:56.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.289288 10958 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 2 FOLLOWER]: Leader election won for term 2
02:12:56.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.290289 10958 raft_consensus.cc:697] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [term 2 LEADER]: Becoming Leader. State: Replica: f6107bf23d3845a5a55485c384d093dd, State: Running, Role: LEADER
02:12:56.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.291105 10958 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } }
02:12:56.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.294818 10961 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6107bf23d3845a5a55485c384d093dd. Latest consensus state: current_term: 2 leader_uuid: "f6107bf23d3845a5a55485c384d093dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:56.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.295497 10961 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: This master's current role is: LEADER
02:12:56.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.296742 10963 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:56.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.302054 10963 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:56.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.304917 10963 catalog_manager.cc:1295] Loaded cluster ID: f3eea57f0c6c40a3bcdbd6cb38f47f7f
02:12:56.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.305184 10963 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:56.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.308580 10963 catalog_manager.cc:1540] Loading token signing keys...
02:12:56.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.311395 10963 catalog_manager.cc:6081] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd: Loaded TSK: 0
02:12:56.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.312484 10963 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:56.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.738344 10240 consensus_peers.cc:597] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd -> Peer 04cbb8f84fcd42f483f6a551ec5235c3 (127.9.248.252:36505): Couldn't send request to peer 04cbb8f84fcd42f483f6a551ec5235c3. Status: Network error: Client connection negotiation failed: client connection to 127.9.248.252:36505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:12:56.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.771445 10342 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [term 2 FOLLOWER]: Refusing update from remote peer f6107bf23d3845a5a55485c384d093dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
02:12:56.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.772814 10961 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
02:12:56.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.777983 10966 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6107bf23d3845a5a55485c384d093dd. Latest consensus state: current_term: 2 leader_uuid: "f6107bf23d3845a5a55485c384d093dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:56.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.778533 10966 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: This master's current role is: FOLLOWER
02:12:56.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.781450 10961 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f6107bf23d3845a5a55485c384d093dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:56.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.782050 10961 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6107bf23d3845a5a55485c384d093dd [sys.catalog]: This master's current role is: LEADER
02:12:56.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.783353 10966 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f6107bf23d3845a5a55485c384d093dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6107bf23d3845a5a55485c384d093dd" member_type: VOTER last_known_addr { host: "127.9.248.254" port: 46883 } } peers { permanent_uuid: "fd7fc2a0682b4a429ff0cf32764d7331" member_type: VOTER last_known_addr { host: "127.9.248.253" port: 39169 } } peers { permanent_uuid: "04cbb8f84fcd42f483f6a551ec5235c3" member_type: VOTER last_known_addr { host: "127.9.248.252" port: 36505 } } }
02:12:56.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.783926 10966 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd7fc2a0682b4a429ff0cf32764d7331 [sys.catalog]: This master's current role is: FOLLOWER
02:12:57.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:57.531037 10653 heartbeater.cc:499] Master 127.9.248.254:46883 was elected leader, sending a full tablet report...
02:12:57.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:57.690028 10932 heartbeater.cc:499] Master 127.9.248.254:46883 was elected leader, sending a full tablet report...
02:12:57.927 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.9.248.252:36505(127.9.248.252:36505)] connecting to peer
02:12:57.928 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:57.928 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.9.248.252:36505(127.9.248.252:36505)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:57.928 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.9.248.252:36505: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505
02:12:57.932 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:57.934 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=50000, elapsed=3103), Traces: [0ms] sending RPC to server master-127.9.248.252:36505, [12ms] received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [12ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [16ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [21ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [21ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [22ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [22ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [36ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [40ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [42ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [57ms] refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [62ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [76ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [80ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [81ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [100ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [102ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [117ms] refreshing cache from master, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [120ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [122ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [122ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [136ms] refreshing cache from master, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [139ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [141ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [141ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [197ms] refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [204ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [205ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [277ms] refreshing cache from master, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [277ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [281ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [282ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [283ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [1217ms] refreshing cache from master, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [1217ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [1218ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [1220ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [1221ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, [1222ms] delaying RPC due to: Service unavailable: Master config (127.9.248.254:46883,127.9.248.253:39169,127.9.248.252:36505) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [3096ms] refreshing cache from master, [3097ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.254:46883, [3097ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.253:39169, [3097ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.248.252:36505, [3099ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.252:36505: Network error: Failed to connect to peer master-127.9.248.252:36505(127.9.248.252:36505): Connection refused: /127.9.248.252:36505, [3101ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.253:39169: OK, [3102ms] Sub RPC ConnectToMaster: received response from server master-127.9.248.254:46883: OK, deferred=Deferred@436681071(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$198/0x00007f591028db68@50acebb9 -> org.apache.kudu.client.AsyncKuduClient$$Lambda$199/0x00007f591028dd90@4b49ec51 -> wakeup thread Time-limited test -> (continuation of Deferred@1602309664 after retry RPC after error@2096027902) -> (continuation of Deferred@1269302777 after retry RPC after error@1325880249) -> (continuation of Deferred@438494263 after retry RPC after error@268564133) -> (continuation of Deferred@453881489 after retry RPC after error@1860349138) -> (continuation of Deferred@1668087397 after retry RPC after error@2085062771) -> (continuation of Deferred@172546124 after retry RPC after error@1907843563) -> (continuation of Deferred@1974216302 after retry RPC after error@904408248) -> (continuation of Deferred@2033060081 after retry RPC after error@861705734) -> (continuation of Deferred@660035925 after retry RPC after error@1395535083) -> (continuation of Deferred@1523503103 after retry RPC after error@234200582), errback=passthrough -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1602309664 after retry RPC after error@2096027902) -> (continuation of Deferred@1269302777 after retry RPC after error@1325880249) -> (continuation of Deferred@438494263 after retry RPC after error@268564133) -> (continuation of Deferred@453881489 after retry RPC after error@1860349138) -> (continuation of Deferred@1668087397 after retry RPC after error@2085062771) -> (continuation of Deferred@172546124 after retry RPC after error@1907843563) -> (continuation of Deferred@1974216302 after retry RPC after error@904408248) -> (continuation of Deferred@2033060081 after retry RPC after error@861705734) -> (continuation of Deferred@660035925 after retry RPC after error@1395535083) -> (continuation of Deferred@1523503103 after retry RPC after error@234200582))) after lookup
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:57.936944 10255 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51778:
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=CREATE_CLIENT"
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:12:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:57.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:57.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:57.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:57.957731 10255 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=CREATE_CLIENT in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:12:57.985 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cb5616db1afd40e1a347fff89bf0f400
02:12:58.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.021095 10579 tablet_service.cc:1511] Processing CreateTablet for tablet 18540f64b6ac41a3bdb69928c52e7e32 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=cb5616db1afd40e1a347fff89bf0f400]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:58.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.023332 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18540f64b6ac41a3bdb69928c52e7e32. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:58.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.031482 10722 tablet_service.cc:1511] Processing CreateTablet for tablet 18540f64b6ac41a3bdb69928c52e7e32 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=cb5616db1afd40e1a347fff89bf0f400]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:58.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.033680 10722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18540f64b6ac41a3bdb69928c52e7e32. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:58.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.034171 10865 tablet_service.cc:1511] Processing CreateTablet for tablet 18540f64b6ac41a3bdb69928c52e7e32 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=cb5616db1afd40e1a347fff89bf0f400]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:58.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.036053 10865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18540f64b6ac41a3bdb69928c52e7e32. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:58.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.068343 10993 tablet_bootstrap.cc:492] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: Bootstrap starting.
02:12:58.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.068519 10992 tablet_bootstrap.cc:492] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: Bootstrap starting.
02:12:58.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.072620 10994 tablet_bootstrap.cc:492] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: Bootstrap starting.
02:12:58.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.077553 10992 tablet_bootstrap.cc:654] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: Neither blocks nor log segments found. Creating new log.
02:12:58.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.080060 10994 tablet_bootstrap.cc:654] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: Neither blocks nor log segments found. Creating new log.
02:12:58.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.080084 10992 log.cc:826] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: Log is configured to *not* fsync() on all Append() calls
02:12:58.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.081969 10993 tablet_bootstrap.cc:654] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: Neither blocks nor log segments found. Creating new log.
02:12:58.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.082350 10994 log.cc:826] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: Log is configured to *not* fsync() on all Append() calls
02:12:58.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.085237 10993 log.cc:826] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: Log is configured to *not* fsync() on all Append() calls
02:12:58.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.093554 10994 tablet_bootstrap.cc:492] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: No bootstrap required, opened a new log
02:12:58.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.094216 10994 ts_tablet_manager.cc:1403] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
02:12:58.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.098155 10992 tablet_bootstrap.cc:492] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: No bootstrap required, opened a new log
02:12:58.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.098701 10992 ts_tablet_manager.cc:1403] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
02:12:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.111753 10993 tablet_bootstrap.cc:492] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: No bootstrap required, opened a new log
02:12:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.112380 10993 ts_tablet_manager.cc:1403] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.013s
02:12:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.126729 10992 raft_consensus.cc:359] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.127887 10992 raft_consensus.cc:385] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:58.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.127521 10994 raft_consensus.cc:359] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.128238 10992 raft_consensus.cc:740] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d359dfee52d432faab9a8e31b5aad9e, State: Initialized, Role: FOLLOWER
02:12:58.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.128414 10994 raft_consensus.cc:385] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:58.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.128717 10994 raft_consensus.cc:740] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95db5c8a909c44778c6166aa566d2ae6, State: Initialized, Role: FOLLOWER
02:12:58.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.129465 10992 consensus_queue.cc:260] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.129889 10994 consensus_queue.cc:260] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.133467 10790 heartbeater.cc:499] Master 127.9.248.254:46883 was elected leader, sending a full tablet report...
02:12:58.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.148543 10993 raft_consensus.cc:359] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.152321 10993 raft_consensus.cc:385] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:58.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.152652 10993 raft_consensus.cc:740] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f2607cc7bca43c79b7ef44968880f26, State: Initialized, Role: FOLLOWER
02:12:58.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.153595 10993 consensus_queue.cc:260] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.155462 10994 ts_tablet_manager.cc:1434] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: Time spent starting tablet: real 0.061s	user 0.033s	sys 0.004s
02:12:58.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.163857 10937 tablet.cc:2406] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:58.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.173933 10998 raft_consensus.cc:493] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:58.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.174630 10998 raft_consensus.cc:515] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.178567 10993 ts_tablet_manager.cc:1434] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: Time spent starting tablet: real 0.066s	user 0.029s	sys 0.024s
02:12:58.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.182773 10992 ts_tablet_manager.cc:1434] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: Time spent starting tablet: real 0.084s	user 0.039s	sys 0.021s
02:12:58.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.200771 10998 leader_election.cc:290] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95db5c8a909c44778c6166aa566d2ae6 (127.9.248.195:37675), 4f2607cc7bca43c79b7ef44968880f26 (127.9.248.194:36261)
02:12:58.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.212440 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18540f64b6ac41a3bdb69928c52e7e32" candidate_uuid: "9d359dfee52d432faab9a8e31b5aad9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2607cc7bca43c79b7ef44968880f26" is_pre_election: true
02:12:58.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.212437 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18540f64b6ac41a3bdb69928c52e7e32" candidate_uuid: "9d359dfee52d432faab9a8e31b5aad9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95db5c8a909c44778c6166aa566d2ae6" is_pre_election: true
02:12:58.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.213369 10885 raft_consensus.cc:2468] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d359dfee52d432faab9a8e31b5aad9e in term 0.
02:12:58.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.213367 10742 raft_consensus.cc:2468] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d359dfee52d432faab9a8e31b5aad9e in term 0.
02:12:58.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.215034 10535 leader_election.cc:304] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f2607cc7bca43c79b7ef44968880f26, 9d359dfee52d432faab9a8e31b5aad9e; no voters: 
02:12:58.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.215804 10998 raft_consensus.cc:2804] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:58.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.216074 10998 raft_consensus.cc:493] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:58.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.216277 10998 raft_consensus.cc:3060] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 0 FOLLOWER]: Advancing to term 1
02:12:58.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.220777 10998 raft_consensus.cc:515] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.222281 10998 leader_election.cc:290] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [CANDIDATE]: Term 1 election: Requested vote from peers 95db5c8a909c44778c6166aa566d2ae6 (127.9.248.195:37675), 4f2607cc7bca43c79b7ef44968880f26 (127.9.248.194:36261)
02:12:58.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.223054 10885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18540f64b6ac41a3bdb69928c52e7e32" candidate_uuid: "9d359dfee52d432faab9a8e31b5aad9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95db5c8a909c44778c6166aa566d2ae6"
02:12:58.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.223426 10742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18540f64b6ac41a3bdb69928c52e7e32" candidate_uuid: "9d359dfee52d432faab9a8e31b5aad9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f2607cc7bca43c79b7ef44968880f26"
02:12:58.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.223726 10885 raft_consensus.cc:3060] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [term 0 FOLLOWER]: Advancing to term 1
02:12:58.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.223821 10742 raft_consensus.cc:3060] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [term 0 FOLLOWER]: Advancing to term 1
02:12:58.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.227310 10654 tablet.cc:2406] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:58.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.229100 10742 raft_consensus.cc:2468] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d359dfee52d432faab9a8e31b5aad9e in term 1.
02:12:58.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.229121 10885 raft_consensus.cc:2468] T 18540f64b6ac41a3bdb69928c52e7e32 P 95db5c8a909c44778c6166aa566d2ae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d359dfee52d432faab9a8e31b5aad9e in term 1.
02:12:58.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.230377 10534 leader_election.cc:304] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95db5c8a909c44778c6166aa566d2ae6, 9d359dfee52d432faab9a8e31b5aad9e; no voters: 
02:12:58.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.231099 10998 raft_consensus.cc:2804] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 1 FOLLOWER]: Leader election won for term 1
02:12:58.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.231489 10998 raft_consensus.cc:697] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [term 1 LEADER]: Becoming Leader. State: Replica: 9d359dfee52d432faab9a8e31b5aad9e, State: Running, Role: LEADER
02:12:58.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.232873 10998 consensus_queue.cc:237] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } }
02:12:58.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.242151 10254 catalog_manager.cc:5697] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d359dfee52d432faab9a8e31b5aad9e (127.9.248.193). New cstate: current_term: 1 leader_uuid: "9d359dfee52d432faab9a8e31b5aad9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d359dfee52d432faab9a8e31b5aad9e" member_type: VOTER last_known_addr { host: "127.9.248.193" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 } health_report { overall_health: UNKNOWN } } }
02:12:58.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.312243 10793 tablet.cc:2406] T 18540f64b6ac41a3bdb69928c52e7e32 P 4f2607cc7bca43c79b7ef44968880f26: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:58.393 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table cb5616db1afd40e1a347fff89bf0f400
02:12:58.399 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 18540f64b6ac41a3bdb69928c52e7e32 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
02:12:58.399 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=18540f64b6ac41a3bdb69928c52e7e32@[4f2607cc7bca43c79b7ef44968880f26(127.9.248.194:36261),95db5c8a909c44778c6166aa566d2ae6(127.9.248.195:37675),9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)[L]]}]
02:12:58.399 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, deferred=null)) after lookup
02:12:58.400 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)] connecting to peer
02:12:58.401 [DEBUG - kudu-nio-7] (Connection.java:757) [peer 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)] Successfully connected to peer
02:12:58.426 [DEBUG - kudu-nio-7] (Negotiator.java:918) Authenticated connection [id: 0xfcfe09ca, L:/127.0.0.1:51636 - R:/127.9.248.193:33969] using TOKEN/null
02:12:58.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.430569 10559 tablet_service.cc:3018] Rejecting scan request for tablet 18540f64b6ac41a3bdb69928c52e7e32: Uninitialized: clean time has not yet been initialized
02:12:58.436 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969) for tablet 18540f64b6ac41a3bdb69928c52e7e32: clean time has not yet been initialized
02:12:58.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 18540f64b6ac41a3bdb69928c52e7e32 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
02:12:58.450 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=18540f64b6ac41a3bdb69928c52e7e32@[4f2607cc7bca43c79b7ef44968880f26(127.9.248.194:36261),95db5c8a909c44778c6166aa566d2ae6(127.9.248.195:37675),9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)[L]]}]
02:12:58.450 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=3, KuduRpc(method=Scan, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=3, TimeoutTracker(timeout=30000, elapsed=56), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [6ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [55ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, deferred=Deferred@1067971694(state=PENDING, result=null, callback=(continuation of Deferred@16059797 after retry RPC@1145815970), errback=(continuation of Deferred@16059797 after retry RPC@1145815970)))) after lookup
02:12:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.455076 10559 tablet_service.cc:3018] Rejecting scan request for tablet 18540f64b6ac41a3bdb69928c52e7e32: Uninitialized: clean time has not yet been initialized
02:12:58.457 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969) for tablet 18540f64b6ac41a3bdb69928c52e7e32: clean time has not yet been initialized
02:12:58.470 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 18540f64b6ac41a3bdb69928c52e7e32 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
02:12:58.471 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=18540f64b6ac41a3bdb69928c52e7e32@[4f2607cc7bca43c79b7ef44968880f26(127.9.248.194:36261),95db5c8a909c44778c6166aa566d2ae6(127.9.248.195:37675),9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)[L]]}]
02:12:58.471 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=5, KuduRpc(method=Scan, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=5, TimeoutTracker(timeout=30000, elapsed=77), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [6ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [55ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [57ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [63ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [63ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [71ms] refreshing cache from master, [72ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [76ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, deferred=Deferred@1067971694(state=PENDING, result=null, callback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627), errback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627)))) after lookup
02:12:58.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.475174 10559 tablet_service.cc:3018] Rejecting scan request for tablet 18540f64b6ac41a3bdb69928c52e7e32: Uninitialized: clean time has not yet been initialized
02:12:58.477 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969) for tablet 18540f64b6ac41a3bdb69928c52e7e32: clean time has not yet been initialized
02:12:58.490 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 18540f64b6ac41a3bdb69928c52e7e32 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
02:12:58.490 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=18540f64b6ac41a3bdb69928c52e7e32@[4f2607cc7bca43c79b7ef44968880f26(127.9.248.194:36261),95db5c8a909c44778c6166aa566d2ae6(127.9.248.195:37675),9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)[L]]}]
02:12:58.491 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=7, KuduRpc(method=Scan, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=7, TimeoutTracker(timeout=30000, elapsed=96), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [6ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [55ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [57ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [63ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [63ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [71ms] refreshing cache from master, [72ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [76ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [77ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [83ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [83ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [91ms] refreshing cache from master, [91ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [95ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, deferred=Deferred@1067971694(state=PENDING, result=null, callback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627) -> (continuation of Deferred@1425915070 after retry RPC@1454524339), errback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627) -> (continuation of Deferred@1425915070 after retry RPC@1454524339)))) after lookup
02:12:58.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.494257 10559 tablet_service.cc:3018] Rejecting scan request for tablet 18540f64b6ac41a3bdb69928c52e7e32: Uninitialized: clean time has not yet been initialized
02:12:58.496 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969) for tablet 18540f64b6ac41a3bdb69928c52e7e32: clean time has not yet been initialized
02:12:58.530 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 18540f64b6ac41a3bdb69928c52e7e32 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
02:12:58.531 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=18540f64b6ac41a3bdb69928c52e7e32@[4f2607cc7bca43c79b7ef44968880f26(127.9.248.194:36261),95db5c8a909c44778c6166aa566d2ae6(127.9.248.195:37675),9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)[L]]}]
02:12:58.531 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=9, KuduRpc(method=Scan, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=9, TimeoutTracker(timeout=30000, elapsed=137), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [6ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [55ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [57ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [63ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [63ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [71ms] refreshing cache from master, [72ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [76ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [77ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [83ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [83ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [91ms] refreshing cache from master, [91ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [95ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [97ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [102ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [102ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [132ms] refreshing cache from master, [132ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [136ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, deferred=Deferred@1067971694(state=PENDING, result=null, callback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627) -> (continuation of Deferred@1425915070 after retry RPC@1454524339) -> (continuation of Deferred@1428805388 after retry RPC@1106728887), errback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627) -> (continuation of Deferred@1425915070 after retry RPC@1454524339) -> (continuation of Deferred@1428805388 after retry RPC@1106728887)))) after lookup
02:12:58.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.535641 10559 tablet_service.cc:3018] Rejecting scan request for tablet 18540f64b6ac41a3bdb69928c52e7e32: Uninitialized: clean time has not yet been initialized
02:12:58.537 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969) for tablet 18540f64b6ac41a3bdb69928c52e7e32: clean time has not yet been initialized
02:12:58.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.805294 11008 consensus_queue.cc:1048] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95db5c8a909c44778c6166aa566d2ae6" member_type: VOTER last_known_addr { host: "127.9.248.195" port: 37675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:58.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.806025 11009 consensus_queue.cc:1048] T 18540f64b6ac41a3bdb69928c52e7e32 P 9d359dfee52d432faab9a8e31b5aad9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f2607cc7bca43c79b7ef44968880f26" member_type: VOTER last_known_addr { host: "127.9.248.194" port: 36261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:58.852 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 18540f64b6ac41a3bdb69928c52e7e32 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
02:12:58.852 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=18540f64b6ac41a3bdb69928c52e7e32@[4f2607cc7bca43c79b7ef44968880f26(127.9.248.194:36261),95db5c8a909c44778c6166aa566d2ae6(127.9.248.195:37675),9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)[L]]}]
02:12:58.853 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=11, KuduRpc(method=Scan, tablet=18540f64b6ac41a3bdb69928c52e7e32, attempt=11, TimeoutTracker(timeout=30000, elapsed=458), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [4ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [6ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [55ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [57ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [63ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [63ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [71ms] refreshing cache from master, [72ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [76ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [77ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [83ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [83ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [91ms] refreshing cache from master, [91ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [95ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [97ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [102ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [102ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [132ms] refreshing cache from master, [132ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [136ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, [138ms] sending RPC to server 9d359dfee52d432faab9a8e31b5aad9e, [143ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [143ms] received response from server 9d359dfee52d432faab9a8e31b5aad9e: Uninitialized: clean time has not yet been initialized (error 0), [452ms] refreshing cache from master, [452ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.248.254:46883, [457ms] Sub RPC GetTableLocations: received response from server master-127.9.248.254:46883: OK, deferred=Deferred@1067971694(state=PENDING, result=null, callback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627) -> (continuation of Deferred@1425915070 after retry RPC@1454524339) -> (continuation of Deferred@1428805388 after retry RPC@1106728887) -> (continuation of Deferred@1927970310 after retry RPC@1767921376), errback=(continuation of Deferred@16059797 after retry RPC@1145815970) -> (continuation of Deferred@1084771502 after retry RPC@1746495627) -> (continuation of Deferred@1425915070 after retry RPC@1454524339) -> (continuation of Deferred@1428805388 after retry RPC@1106728887) -> (continuation of Deferred@1927970310 after retry RPC@1767921376)))) after lookup
02:12:58.882 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=CREATE_CLIENT, tablet=18540f64b6ac41a3bdb69928c52e7e32, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:12:58.883 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:12:58.886 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.253:39169(127.9.248.253:39169)] disconnecting while in state READY
02:12:58.887 [DEBUG - main] (Connection.java:575) [peer 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)] disconnecting while in state READY
02:12:58.887 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.254:46883(127.9.248.254:46883)] disconnecting while in state READY
02:12:58.887 [DEBUG - main] (Connection.java:575) [peer master-127.9.248.252:36505(127.9.248.252:36505)] disconnecting while in state TERMINATED
02:12:58.887 [DEBUG - kudu-nio-7] (Connection.java:239) [peer 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)] handling channelInactive
02:12:58.887 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.248.253:39169(127.9.248.253:39169)] handling channelInactive
02:12:58.888 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 9d359dfee52d432faab9a8e31b5aad9e(127.9.248.193:33969)] cleaning up while in state READY due to: connection closed
02:12:58.888 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:12:58.889 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.248.253:39169(127.9.248.253:39169)] cleaning up while in state READY due to: connection closed
02:12:58.890 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.248.254:46883(127.9.248.254:46883)] handling channelInactive
02:12:58.890 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.248.254:46883(127.9.248.254:46883)] cleaning up while in state READY due to: connection closed
02:12:58.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.892591 10211 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 10493
02:12:58.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.921336 10211 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 10650
02:12:58.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.950148 10211 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 10798
02:12:58.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.978561 10211 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 10223
02:12:59.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.012770 10211 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 10293
02:13:00.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:00Z chronyd exiting
.02:13:01.272 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783476781271
02:13:01.275 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:13:01.276 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:13:01.276 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskdJk2H7/test-tmp
02:13:01.276 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:13:01.276 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskdJk2H7/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:13:01.279 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:13:01.639 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:13:01.640 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:13:01.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.643435 11031 mini_oidc.cc:150] Starting JWKS server
02:13:01.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.646716 11031 webserver.cc:533] Webserver started at http://127.0.0.1:45371/ using document root <none> and password file <none>
02:13:01.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.647161 11031 mini_oidc.cc:186] Starting OIDC Discovery server
02:13:01.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.648876 11031 webserver.cc:533] Webserver started at http://127.0.0.1:42613/ using document root <none> and password file <none>
02:13:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:01Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:13:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:01Z Disabled control of system clock
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.715207 11031 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:01.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/logs
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data/info.pb
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.254:45017
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.254
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:01.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:01.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:01.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45371/jwks.json with env {}
02:13:02.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.032614 11043 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:02.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.033192 11043 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:02.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.033648 11043 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:02.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.067698 11043 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:13:02.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.068001 11043 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:02.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.068197 11043 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:13:02.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.068399 11043 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:13:02.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.068579 11043 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:13:02.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.068728 11043 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45371/jwks.json
02:13:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.106199 11043 master_runner.cc:387] Master server non-default flags:
02:13:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:02.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.254:45017
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45371/jwks.json
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data/info.pb
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.254
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/logs
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.107628 11043 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:02.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.109220 11043 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:02.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.120128 11049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:03.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.524415 11048 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 11043
02:13:03.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.951894 11048 kernel_stack_watchdog.cc:198] Thread 11043 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
02:13:03.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:13:03.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:13:03.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:13:03.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:13:03.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.952243 11043 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.832s	user 0.660s	sys 1.169s
02:13:03.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.952643 11043 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.832s	user 0.660s	sys 1.169s
02:13:03.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.120873 11050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:03.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.954648 11052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:03.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.958267 11051 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1832 milliseconds
02:13:03.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.958292 11043 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:03.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.959649 11043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:03.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.962182 11043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:03.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.963582 11043 hybrid_clock.cc:648] HybridClock initialized: now 1783476783963542 us; error 43 us; skew 500 ppm
02:13:03.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.964478 11043 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:03.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.971078 11043 webserver.cc:533] Webserver started at http://127.10.197.254:37981/ using document root <none> and password file <none>
02:13:03.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.972095 11043 fs_manager.cc:362] Metadata directory not provided
02:13:03.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.972350 11043 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:03.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.972905 11043 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:03.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.977324 11043 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data/instance:
02:13:03.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "75d3a0fdc44749a7a955c46eb8d96f22"
02:13:03.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:03 on dist-test-slave-3kxw"
02:13:03.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.978767 11043 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal/instance:
02:13:03.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "75d3a0fdc44749a7a955c46eb8d96f22"
02:13:03.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:03 on dist-test-slave-3kxw"
02:13:03.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.986985 11043 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
02:13:03.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.993582 11059 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:03.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.994949 11043 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
02:13:03.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.995275 11043 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal
02:13:03.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "75d3a0fdc44749a7a955c46eb8d96f22"
02:13:03.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:03 on dist-test-slave-3kxw"
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.995600 11043 fs_report.cc:389] FS layout report
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data/data
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:04.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.057945 11043 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:04.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.059450 11043 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:04.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.059890 11043 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:04.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.150025 11043 rpc_server.cc:307] RPC server started. Bound to: 127.10.197.254:45017
02:13:04.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.150082 11110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.197.254:45017 every 8 connection(s)
02:13:04.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.152868 11043 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/data/info.pb
02:13:04.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.155368 11031 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11043
02:13:04.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.155961 11031 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-0/wal/instance
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.161579 11031 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/logs
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data/info.pb
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:04.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.253:35437
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.253
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45371/jwks.json with env {}
02:13:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.161963 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:04.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.174355 11111 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } has no permanent_uuid. Determining permanent_uuid...
02:13:04.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.214178 11111 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } has no permanent_uuid. Determining permanent_uuid...
02:13:04.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.217427 11063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:04.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.222451 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.272039 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 1
02:13:04.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.277480 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:04.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.345973 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 2
02:13:04.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.351341 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:04.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.442821 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 3
02:13:04.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.447722 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:04.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.494580 11113 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:04.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.495309 11113 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:04.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.495936 11113 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:04.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.528682 11113 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:13:04.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.529131 11113 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:04.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.529543 11113 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:13:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.529973 11113 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:13:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.530200 11113 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:13:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.530357 11113 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45371/jwks.json
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.567634 11113 master_runner.cc:387] Master server non-default flags:
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.253:35437
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:04.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45371/jwks.json
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data/info.pb
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.253
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/logs
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:04.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.569068 11113 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:04.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.570669 11113 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:04.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.582794 11122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.591192 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 4
02:13:04.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.599859 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:04.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.899441 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 5
02:13:04.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.910326 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:05.458019 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 6
02:13:05.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:05.483083 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.583890 11123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.388054 11113 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.805s	user 0.678s	sys 1.118s
02:13:06.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:05.986899 11121 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 11113
02:13:06.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.388767 11113 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.806s	user 0.678s	sys 1.119s
02:13:06.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.390514 11125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:06.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.392519 11124 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1805 milliseconds
02:13:06.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.392549 11113 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:06.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.393803 11113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:06.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.396402 11113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:06.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.397790 11113 hybrid_clock.cc:648] HybridClock initialized: now 1783476786397751 us; error 39 us; skew 500 ppm
02:13:06.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.398742 11113 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:06.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.405061 11113 webserver.cc:533] Webserver started at http://127.10.197.253:34959/ using document root <none> and password file <none>
02:13:06.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.406107 11113 fs_manager.cc:362] Metadata directory not provided
02:13:06.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.406358 11113 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:06.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.406935 11113 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:06.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.411305 11113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data/instance:
02:13:06.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0d59417ae354446806c5e9b85fd7ad4"
02:13:06.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:06 on dist-test-slave-3kxw"
02:13:06.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.412712 11113 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal/instance:
02:13:06.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0d59417ae354446806c5e9b85fd7ad4"
02:13:06.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:06 on dist-test-slave-3kxw"
02:13:06.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.420145 11113 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.001s
02:13:06.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.426079 11134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:06.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.427188 11113 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.003s
02:13:06.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.427556 11113 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0d59417ae354446806c5e9b85fd7ad4"
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:06 on dist-test-slave-3kxw"
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.427966 11113 fs_report.cc:389] FS layout report
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data/data
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:06.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:06.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:06.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:06.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:06.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:06.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:06.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:06.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.479560 11113 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:06.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.481158 11113 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:06.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.481694 11113 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:06.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.543715 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 7
02:13:06.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.551435 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.253:35437: Network error: Client connection negotiation failed: client connection to 127.10.197.253:35437: connect: Connection refused (error 111)
02:13:06.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.555451 11113 rpc_server.cc:307] RPC server started. Bound to: 127.10.197.253:35437
02:13:06.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.555537 11188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.197.253:35437 every 8 connection(s)
02:13:06.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.558405 11113 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/data/info.pb
02:13:06.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.564523 11189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.568534 11031 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11113
02:13:06.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.569006 11031 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-1/wal/instance
02:13:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.571255 11031 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal
02:13:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data
02:13:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:06.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/logs
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data/info.pb
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:06.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.252:34729
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.252
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:06.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45371/jwks.json with env {}
02:13:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.576436 11189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } has no permanent_uuid. Determining permanent_uuid...
02:13:06.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.605921 11189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } has no permanent_uuid. Determining permanent_uuid...
02:13:06.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.621138 11189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } has no permanent_uuid. Determining permanent_uuid...
02:13:06.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.624022 11135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:06.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.629072 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.678679 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 1
02:13:06.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.683337 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:06.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.751754 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 2
02:13:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.756489 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.848062 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 3
02:13:06.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.852598 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:06.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.901219 11191 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:06.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.901932 11191 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:06.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.902418 11191 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:06.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.940766 11191 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:13:06.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.941138 11191 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:06.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.941330 11191 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:13:06.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.941530 11191 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:13:06.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.941723 11191 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:13:06.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.941959 11191 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:45371/jwks.json
02:13:06.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.979311 11191 master_runner.cc:387] Master server non-default flags:
02:13:06.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:06.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.252:34729
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:45371/jwks.json
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data/info.pb
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.252
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/logs
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:13:06.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.980640 11191 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:06.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.982796 11191 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:06.996059 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 4
02:13:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.997061 11201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:07.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:07.003943 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:07.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:07.303534 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 5
02:13:07.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:07.311901 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:07.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:07.859485 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 6
02:13:07.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:07.898422 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:08.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.641929 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } attempt: 8
02:13:08.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.673941 11111 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } has no permanent_uuid. Determining permanent_uuid...
02:13:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.702191 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:08.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.767791 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 1
02:13:08.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.775933 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:08.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.829509 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 2
02:13:08.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.843808 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:08.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.401332 11200 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 11191
02:13:08.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.857424 11191 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.859s	user 0.618s	sys 1.228s
02:13:08.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.858546 11191 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.860s	user 0.619s	sys 1.228s
02:13:08.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:06.999539 11202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:08.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.860496 11204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.863909 11203 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1861 milliseconds
02:13:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.863951 11191 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:08.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.865346 11191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:08.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.867844 11191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:08.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.869246 11191 hybrid_clock.cc:648] HybridClock initialized: now 1783476788869209 us; error 42 us; skew 500 ppm
02:13:08.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.870208 11191 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:08.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.876430 11191 webserver.cc:533] Webserver started at http://127.10.197.252:35255/ using document root <none> and password file <none>
02:13:08.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.877485 11191 fs_manager.cc:362] Metadata directory not provided
02:13:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.877749 11191 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.878326 11191 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:08.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.882892 11191 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data/instance:
02:13:08.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d23a1b261b14f9fb206017eb32b3df5"
02:13:08.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:08 on dist-test-slave-3kxw"
02:13:08.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.884090 11191 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal/instance:
02:13:08.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d23a1b261b14f9fb206017eb32b3df5"
02:13:08.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:08 on dist-test-slave-3kxw"
02:13:08.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.892503 11191 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.005s
02:13:08.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.898497 11217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:08.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.899816 11191 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
02:13:08.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.900135 11191 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal
02:13:08.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1d23a1b261b14f9fb206017eb32b3df5"
02:13:08.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:08 on dist-test-slave-3kxw"
02:13:08.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.900444 11191 fs_report.cc:389] FS layout report
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data/data
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:08.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.920396 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 3
02:13:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.925905 11111 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:08.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.958978 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 7
02:13:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:08.966138 11189 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.197.252:34729: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.967633 11191 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:08.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.969249 11191 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:08.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:08.969786 11191 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:09.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.042496 11191 rpc_server.cc:307] RPC server started. Bound to: 127.10.197.252:34729
02:13:09.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.042570 11270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.197.252:34729 every 8 connection(s)
02:13:09.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.045409 11191 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/data/info.pb
02:13:09.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.051362 11271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:09.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.052591 11031 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11191
02:13:09.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.053068 11031 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/master-2/wal/instance
02:13:09.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.065786 11271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } has no permanent_uuid. Determining permanent_uuid...
02:13:09.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.081410 11111 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 4
02:13:09.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.091934 11271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } has no permanent_uuid. Determining permanent_uuid...
02:13:09.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.104663 11271 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } has no permanent_uuid. Determining permanent_uuid...
02:13:09.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.108016 11111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: Bootstrap starting.
02:13:09.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.115978 11111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: Neither blocks nor log segments found. Creating new log.
02:13:09.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.118713 11111 log.cc:826] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: Log is configured to *not* fsync() on all Append() calls
02:13:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.123512 11271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: Bootstrap starting.
02:13:09.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.123900 11111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: No bootstrap required, opened a new log
02:13:09.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.130421 11271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: Neither blocks nor log segments found. Creating new log.
02:13:09.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.132100 11271 log.cc:826] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: Log is configured to *not* fsync() on all Append() calls
02:13:09.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.140898 11271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: No bootstrap required, opened a new log
02:13:09.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.146834 11111 raft_consensus.cc:359] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.148067 11111 raft_consensus.cc:385] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.148586 11111 raft_consensus.cc:740] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75d3a0fdc44749a7a955c46eb8d96f22, State: Initialized, Role: FOLLOWER
02:13:09.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.149883 11111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.159080 11281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:09.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.161257 11281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: This master's current role is: FOLLOWER
02:13:09.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.160878 11111 sys_catalog.cc:565] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: configured and running, proceeding with master startup.
02:13:09.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.164577 11271 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.165467 11271 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:09.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.165772 11271 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d23a1b261b14f9fb206017eb32b3df5, State: Initialized, Role: FOLLOWER
02:13:09.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.166903 11271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.170094 11283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:09.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.171120 11283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: This master's current role is: FOLLOWER
02:13:09.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.172123 11271 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: configured and running, proceeding with master startup.
02:13:09.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:09.226002 11303 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:13:09.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:09.226764 11303 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:13:09.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:09.229669 11305 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:13:09.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:09.225111 11225 tablet.cc:2406] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:09.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:09.230078 11305 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:13:09.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.225059 11191 master_runner.cc:187] Error getting master registration for 127.10.197.253:35437: OK, instance_id { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" instance_seqno: 1783476786533945 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:13:09.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.257584 11191 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:13:09.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.217392 11043 master_runner.cc:187] Error getting master registration for 127.10.197.253:35437: OK, instance_id { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" instance_seqno: 1783476786533945 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:13:09.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.262382 11043 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:13:09.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:09.322431 11065 tablet.cc:2406] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:09.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.363821 11283 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:13:09.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.364496 11283 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.369156 11086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d23a1b261b14f9fb206017eb32b3df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" is_pre_election: true
02:13:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.370214 11086 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d23a1b261b14f9fb206017eb32b3df5 in term 0.
02:13:09.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.372279 11218 leader_election.cc:304] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d23a1b261b14f9fb206017eb32b3df5, 75d3a0fdc44749a7a955c46eb8d96f22; no voters: 
02:13:09.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.375885 11283 leader_election.cc:290] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75d3a0fdc44749a7a955c46eb8d96f22 (127.10.197.254:45017), f0d59417ae354446806c5e9b85fd7ad4 (127.10.197.253:35437)
02:13:09.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.377012 11283 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:13:09.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.377734 11283 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:13:09.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.378764 11283 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 0 FOLLOWER]: Advancing to term 1
02:13:09.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.389698 11283 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.393388 11086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d23a1b261b14f9fb206017eb32b3df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75d3a0fdc44749a7a955c46eb8d96f22"
02:13:09.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.393407 11283 leader_election.cc:290] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [CANDIDATE]: Term 1 election: Requested vote from peers 75d3a0fdc44749a7a955c46eb8d96f22 (127.10.197.254:45017), f0d59417ae354446806c5e9b85fd7ad4 (127.10.197.253:35437)
02:13:09.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.394089 11086 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 0 FOLLOWER]: Advancing to term 1
02:13:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.405917 11086 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d23a1b261b14f9fb206017eb32b3df5 in term 1.
02:13:09.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.415696 11218 leader_election.cc:304] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d23a1b261b14f9fb206017eb32b3df5, 75d3a0fdc44749a7a955c46eb8d96f22; no voters: 
02:13:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.416600 11283 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 1 FOLLOWER]: Leader election won for term 1
02:13:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.417096 11283 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [term 1 LEADER]: Becoming Leader. State: Replica: 1d23a1b261b14f9fb206017eb32b3df5, State: Running, Role: LEADER
02:13:09.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.418076 11283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:09.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.429117 11308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d23a1b261b14f9fb206017eb32b3df5. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:09.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.430655 11308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: This master's current role is: LEADER
02:13:09.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.445525 11310 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:13:09.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.453502 11310 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:13:09.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.478173 11086 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Refusing update from remote peer 1d23a1b261b14f9fb206017eb32b3df5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:13:09.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.480476 11308 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:13:09.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.511523 11281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d23a1b261b14f9fb206017eb32b3df5. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:09.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.512333 11281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: This master's current role is: FOLLOWER
02:13:09.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.520761 11311 mvcc.cc:204] Tried to move back new op lower bound from 7305120929674735616 to 7305120929465679872. Current Snapshot: MvccSnapshot[applied={T|T < 7305120929674735616}]
02:13:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.525168 11312 mvcc.cc:204] Tried to move back new op lower bound from 7305120929674735616 to 7305120929465679872. Current Snapshot: MvccSnapshot[applied={T|T < 7305120929674735616}]
02:13:09.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.530263 11281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:09.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.531059 11281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: This master's current role is: FOLLOWER
02:13:09.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.534914 11308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:09.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.535717 11308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: This master's current role is: LEADER
02:13:09.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.544075 11310 catalog_manager.cc:1383] Generated new cluster ID: 4e08229020d44fd58d1cb40dd704a033
02:13:09.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.544410 11310 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:13:09.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.587649 11310 catalog_manager.cc:1406] Generated new certificate authority record
02:13:09.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.589882 11310 catalog_manager.cc:1540] Loading token signing keys...
02:13:09.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.626833 11310 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5: Generated new TSK 0
02:13:09.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.628033 11310 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:09.663980 11031 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/logs
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data/info.pb
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.193:0
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.197.193
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.193
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:13:10.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.217550 11316 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:10.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.231726 11316 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:10.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.232977 11303 catalog_manager.cc:1295] Loaded cluster ID: 4e08229020d44fd58d1cb40dd704a033
02:13:10.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.233260 11316 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:10.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.233476 11303 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: loading cluster ID for follower catalog manager: success
02:13:10.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.254035 11303 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: acquiring CA information for follower catalog manager: success
02:13:10.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.261092 11303 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:13:10.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.329172 11316 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:10.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.330946 11316 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.197.193
02:13:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.398118 11316 tablet_server_runner.cc:78] Tablet server non-default flags:
02:13:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:10.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.193:0
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data/info.pb
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.193
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.197.193
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/logs
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:10.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.401373 11316 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:10.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:10.403863 11316 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:10.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.432462 11324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:11.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.010819 11221 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.10.197.253:35437 timed out after 1.617s (SENT)
02:13:11.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.056490 11189 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } attempt: 8
02:13:11.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.273873 11189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: Bootstrap starting.
02:13:11.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.294641 11189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: Neither blocks nor log segments found. Creating new log.
02:13:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.297360 11189 log.cc:826] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: Log is configured to *not* fsync() on all Append() calls
02:13:11.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.345666 11189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: No bootstrap required, opened a new log
02:13:11.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.403842 11189 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:11.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.404847 11189 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:11.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.405128 11189 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d59417ae354446806c5e9b85fd7ad4, State: Initialized, Role: FOLLOWER
02:13:11.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.418265 11189 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:11.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.427956 11334 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:11.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.428928 11334 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: This master's current role is: FOLLOWER
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.432237 11189 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: configured and running, proceeding with master startup.
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.432394 11162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d23a1b261b14f9fb206017eb32b3df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d59417ae354446806c5e9b85fd7ad4" is_pre_election: true
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.433390 11162 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d23a1b261b14f9fb206017eb32b3df5 in term 0.
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.434049 11161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d23a1b261b14f9fb206017eb32b3df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d59417ae354446806c5e9b85fd7ad4"
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.435065 11161 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54722 (request call id 3) took 2042 ms (client timeout 1617 ms). Trace:
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.435531 11161 rpcz_store.cc:269] 0708 02:13:09.392732 (+     0us) service_pool.cc:167] Inserting onto call queue
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:09.392887 (+   155us) service_pool.cc:224] Handling call
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:11.434984 (+2042097us) inbound_call.cc:177] Queueing success response
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:13:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.436781 11159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d23a1b261b14f9fb206017eb32b3df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d59417ae354446806c5e9b85fd7ad4"
02:13:11.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.440626 11158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d23a1b261b14f9fb206017eb32b3df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d59417ae354446806c5e9b85fd7ad4" is_pre_election: true
02:13:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.443403 11162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54722 (request call id 2) took 2071 ms (client timeout 1905 ms). Trace:
02:13:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.443821 11162 rpcz_store.cc:269] 0708 02:13:09.371600 (+     0us) service_pool.cc:167] Inserting onto call queue
02:13:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:09.371778 (+   178us) service_pool.cc:224] Handling call
02:13:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:11.443332 (+2071554us) inbound_call.cc:177] Queueing success response
02:13:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:13:11.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.445027 11160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 0 FOLLOWER]: Advancing to term 1
02:13:11.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.455343 11160 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 1 FOLLOWER]: Refusing update from remote peer 1d23a1b261b14f9fb206017eb32b3df5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:13:11.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.473100 11160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54722 (request call id 4) took 1997 ms. Trace:
02:13:11.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.474852 11160 rpcz_store.cc:276] 0708 02:13:09.475498 (+     0us) service_pool.cc:167] Inserting onto call queue
02:13:11.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:09.475640 (+   142us) service_pool.cc:224] Handling call
02:13:11.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:11.444713 (+1969073us) raft_consensus.cc:1471] Updating replica for 0 ops
02:13:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:11.457531 (+ 12818us) raft_consensus.cc:1697] Filling consensus response to leader.
02:13:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:11.472770 (+ 15239us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b5400030550. stack: 00007f4b1cb51543 00007f4b1cb51440 00007f4b1c701574 000000000050ee54 000000000050ede9 00007f4b23c36951 00007f4b23cccc8d 00007f4b24cfdb19 00007f4b233afd34 00007f4b233afcc2 00007f4b233afbf1 00007f4b233afb6c 00007f4b233aee22 00007f4b2199dcac 00007f4b2199d0e6 00007f4b2199ca8f
02:13:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:13:11.473016 (+   246us) inbound_call.cc:177] Queueing success response
02:13:11.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"spinlock_wait_cycles":9717632}
02:13:11.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.479496 11328 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:13:11.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.496418 11140 tablet.cc:2406] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:11.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.553295 11334 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d23a1b261b14f9fb206017eb32b3df5. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:11.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.554023 11334 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: This master's current role is: FOLLOWER
02:13:11.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.561571 11346 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:11.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.562880 11346 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: This master's current role is: FOLLOWER
02:13:11.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.574465 11350 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:13:11.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.930271 11328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d23a1b261b14f9fb206017eb32b3df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:11.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:11.931774 11328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d23a1b261b14f9fb206017eb32b3df5 [sys.catalog]: This master's current role is: LEADER
02:13:12.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:12.595052 11350 catalog_manager.cc:1295] Loaded cluster ID: 4e08229020d44fd58d1cb40dd704a033
02:13:12.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:12.595355 11350 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: loading cluster ID for follower catalog manager: success
02:13:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:12.604763 11350 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: acquiring CA information for follower catalog manager: success
02:13:12.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:12.622790 11350 catalog_manager.cc:1638] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:13:13.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:10.434180 11325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:13.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.090685 11316 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.661s	user 0.897s	sys 1.570s
02:13:13.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:11.824579 11323 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 11316
02:13:13.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.092375 11316 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.663s	user 0.897s	sys 1.570s
02:13:13.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.100675 11357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:13.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.101536 11316 server_base.cc:1061] running on GCE node
02:13:13.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.103029 11316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:13.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.105717 11316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:13.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.107197 11316 hybrid_clock.cc:648] HybridClock initialized: now 1783476793107114 us; error 86 us; skew 500 ppm
02:13:13.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.108325 11316 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:13.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.116110 11316 webserver.cc:533] Webserver started at http://127.10.197.193:46675/ using document root <none> and password file <none>
02:13:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.117362 11316 fs_manager.cc:362] Metadata directory not provided
02:13:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.117648 11316 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:13.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.118397 11316 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:13.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.124924 11316 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data/instance:
02:13:13.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "be8fe78ad53645b8af1df6ed36d5cfd7"
02:13:13.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:13 on dist-test-slave-3kxw"
02:13:13.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.126564 11316 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal/instance:
02:13:13.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "be8fe78ad53645b8af1df6ed36d5cfd7"
02:13:13.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:13 on dist-test-slave-3kxw"
02:13:13.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.160611 11316 fs_manager.cc:696] Time spent creating directory manager: real 0.033s	user 0.018s	sys 0.014s
02:13:13.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.178781 11362 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:13.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.180451 11316 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.005s	sys 0.007s
02:13:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.180899 11316 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal
02:13:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "be8fe78ad53645b8af1df6ed36d5cfd7"
02:13:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:13 on dist-test-slave-3kxw"
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.181367 11316 fs_report.cc:389] FS layout report
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data/data
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:13.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:13.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.245023 11316 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:13.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.246834 11316 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:13.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.247402 11316 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:13.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.250841 11316 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:13:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.256289 11316 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:13:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.256563 11316 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:13:13.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.256884 11316 ts_tablet_manager.cc:616] Registered 0 tablets
02:13:13.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.257093 11316 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:13:13.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.447911 11316 rpc_server.cc:307] RPC server started. Bound to: 127.10.197.193:46467
02:13:13.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.448026 11475 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.197.193:46467 every 8 connection(s)
02:13:13.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.450747 11316 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/data/info.pb
02:13:13.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.460152 11031 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11316
02:13:13.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.461041 11031 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-0/wal/instance
02:13:13.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.498312 11031 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/logs
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data/info.pb
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.194:0
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.197.194
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.194
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:13:13.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.503890 11477 heartbeater.cc:344] Connected to a master server at 127.10.197.253:35437
02:13:13.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.504454 11477 heartbeater.cc:461] Registering TS with master...
02:13:13.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.505949 11477 heartbeater.cc:507] Master 127.10.197.253:35437 requested a full tablet report, sending...
02:13:13.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.508312 11476 heartbeater.cc:344] Connected to a master server at 127.10.197.252:34729
02:13:13.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.508675 11476 heartbeater.cc:461] Registering TS with master...
02:13:13.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.509665 11476 heartbeater.cc:507] Master 127.10.197.252:34729 requested a full tablet report, sending...
02:13:13.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.509889 11152 ts_manager.cc:194] Registered new tserver with Master: be8fe78ad53645b8af1df6ed36d5cfd7 (127.10.197.193:46467)
02:13:13.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.512491 11236 ts_manager.cc:194] Registered new tserver with Master: be8fe78ad53645b8af1df6ed36d5cfd7 (127.10.197.193:46467)
02:13:13.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.515123 11478 heartbeater.cc:344] Connected to a master server at 127.10.197.254:45017
02:13:13.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.515494 11478 heartbeater.cc:461] Registering TS with master...
02:13:13.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.516008 11236 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.197.193:60431
02:13:13.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.516460 11478 heartbeater.cc:507] Master 127.10.197.254:45017 requested a full tablet report, sending...
02:13:13.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.519809 11076 ts_manager.cc:194] Registered new tserver with Master: be8fe78ad53645b8af1df6ed36d5cfd7 (127.10.197.193:46467)
02:13:13.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.843807 11486 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:13.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.844405 11486 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:13.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.845001 11486 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:13.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.878888 11486 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:13.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.880002 11486 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.197.194
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.922727 11486 tablet_server_runner.cc:78] Tablet server non-default flags:
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.194:0
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data/info.pb
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.194
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:13.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.197.194
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/logs
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.924477 11486 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:13.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:13.926344 11486 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.940462 11492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:14.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:14.519968 11476 heartbeater.cc:499] Master 127.10.197.252:34729 was elected leader, sending a full tablet report...
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:15.345237 11491 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 11486
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.106740 11491 kernel_stack_watchdog.cc:198] Thread 11486 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.107131 11486 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.165s	user 0.707s	sys 1.270s
02:13:16.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.107481 11486 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.166s	user 0.707s	sys 1.270s
02:13:16.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:13.941499 11493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:16.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.109236 11495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.114594 11494 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2171 milliseconds
02:13:16.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.114637 11486 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:16.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.116490 11486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:16.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.119419 11486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:16.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.120868 11486 hybrid_clock.cc:648] HybridClock initialized: now 1783476796120815 us; error 67 us; skew 500 ppm
02:13:16.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.121985 11486 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.129539 11486 webserver.cc:533] Webserver started at http://127.10.197.194:34643/ using document root <none> and password file <none>
02:13:16.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.130795 11486 fs_manager.cc:362] Metadata directory not provided
02:13:16.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.131098 11486 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:16.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.131680 11486 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:16.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.137107 11486 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data/instance:
02:13:16.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39152289de284ce6a2d1ec1526f1e0e0"
02:13:16.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:16 on dist-test-slave-3kxw"
02:13:16.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.138339 11486 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal/instance:
02:13:16.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39152289de284ce6a2d1ec1526f1e0e0"
02:13:16.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:16 on dist-test-slave-3kxw"
02:13:16.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.146595 11486 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
02:13:16.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.154749 11503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:16.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.156241 11486 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.001s
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.156651 11486 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39152289de284ce6a2d1ec1526f1e0e0"
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:16 on dist-test-slave-3kxw"
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.157081 11486 fs_report.cc:389] FS layout report
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data/data
02:13:16.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:16.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:16.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.240015 11486 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:16.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.241528 11486 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:16.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.242038 11486 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:16.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.244668 11486 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:13:16.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.248906 11486 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:13:16.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.249118 11486 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:13:16.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.249313 11486 ts_tablet_manager.cc:616] Registered 0 tablets
02:13:16.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.249441 11486 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:13:16.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.390862 11486 rpc_server.cc:307] RPC server started. Bound to: 127.10.197.194:37229
02:13:16.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.391125 11616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.197.194:37229 every 8 connection(s)
02:13:16.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.393334 11486 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/data/info.pb
02:13:16.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.394626 11031 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11486
02:13:16.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.395251 11031 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-1/wal/instance
02:13:16.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.419245 11031 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/logs
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data/info.pb
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.195:0
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.197.195
02:13:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.195
02:13:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:16.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:13:16.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.452890 11619 heartbeater.cc:344] Connected to a master server at 127.10.197.254:45017
02:13:16.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.453348 11619 heartbeater.cc:461] Registering TS with master...
02:13:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.454722 11619 heartbeater.cc:507] Master 127.10.197.254:45017 requested a full tablet report, sending...
02:13:16.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.455566 11618 heartbeater.cc:344] Connected to a master server at 127.10.197.253:35437
02:13:16.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.455951 11618 heartbeater.cc:461] Registering TS with master...
02:13:16.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.456913 11618 heartbeater.cc:507] Master 127.10.197.253:35437 requested a full tablet report, sending...
02:13:16.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.458231 11076 ts_manager.cc:194] Registered new tserver with Master: 39152289de284ce6a2d1ec1526f1e0e0 (127.10.197.194:37229)
02:13:16.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.460219 11152 ts_manager.cc:194] Registered new tserver with Master: 39152289de284ce6a2d1ec1526f1e0e0 (127.10.197.194:37229)
02:13:16.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.461361 11617 heartbeater.cc:344] Connected to a master server at 127.10.197.252:34729
02:13:16.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.461674 11617 heartbeater.cc:461] Registering TS with master...
02:13:16.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.462617 11617 heartbeater.cc:507] Master 127.10.197.252:34729 requested a full tablet report, sending...
02:13:16.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.465024 11236 ts_manager.cc:194] Registered new tserver with Master: 39152289de284ce6a2d1ec1526f1e0e0 (127.10.197.194:37229)
02:13:16.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.466796 11236 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.197.194:33521
02:13:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.771520 11627 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.772010 11627 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.772410 11627 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:16.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.805840 11627 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:16.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.806651 11627 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.197.195
02:13:16.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.843494 11627 tablet_server_runner.cc:78] Tablet server non-default flags:
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.197.212:41523
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.197.195:0
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data/info.pb
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.197.195
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.197.254:45017,127.10.197.253:35437,127.10.197.252:34729
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.197.195
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/logs
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:16.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.844790 11627 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:16.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:16.846452 11627 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:16.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.859193 11633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:17.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:17.470402 11617 heartbeater.cc:499] Master 127.10.197.252:34729 was elected leader, sending a full tablet report...
02:13:18.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:18.266256 11632 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 11627
02:13:18.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:16.859951 11634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:18.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:18.294049 11627 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.435s	user 0.544s	sys 0.879s
02:13:18.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:18.294888 11627 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.436s	user 0.544s	sys 0.879s
02:13:18.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:18.296779 11636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:18.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:18.299130 11635 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1435 milliseconds
02:13:18.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.299208 11627 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.300518 11627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:18.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.302768 11627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:18.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.304158 11627 hybrid_clock.cc:648] HybridClock initialized: now 1783476798304125 us; error 39 us; skew 500 ppm
02:13:18.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.305008 11627 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:18.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.311604 11627 webserver.cc:533] Webserver started at http://127.10.197.195:34513/ using document root <none> and password file <none>
02:13:18.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.312618 11627 fs_manager.cc:362] Metadata directory not provided
02:13:18.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.312887 11627 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:18.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.313411 11627 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.317749 11627 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data/instance:
02:13:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16ffd0429cff4633ac4bb179de62687b"
02:13:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:18 on dist-test-slave-3kxw"
02:13:18.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.318998 11627 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal/instance:
02:13:18.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16ffd0429cff4633ac4bb179de62687b"
02:13:18.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:18 on dist-test-slave-3kxw"
02:13:18.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.326498 11627 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
02:13:18.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.332940 11644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:18.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.334352 11627 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.001s
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.334699 11627 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16ffd0429cff4633ac4bb179de62687b"
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:18 on dist-test-slave-3kxw"
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.335022 11627 fs_report.cc:389] FS layout report
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data/data
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:18.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:18.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:18.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.393385 11627 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:18.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.395531 11627 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:18.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.396126 11627 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:18.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.399741 11627 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:13:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.405771 11627 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:13:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.406100 11627 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
02:13:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.406409 11627 ts_tablet_manager.cc:616] Registered 0 tablets
02:13:18.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.406630 11627 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:13:18.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.590588 11627 rpc_server.cc:307] RPC server started. Bound to: 127.10.197.195:45361
02:13:18.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.590698 11757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.197.195:45361 every 8 connection(s)
02:13:18.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.593537 11627 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/data/info.pb
02:13:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.596474 11031 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11627
02:13:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.596944 11031 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster8853951393199224384/ts-2/wal/instance
02:13:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.643594 11760 heartbeater.cc:344] Connected to a master server at 127.10.197.254:45017
02:13:18.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.644106 11760 heartbeater.cc:461] Registering TS with master...
02:13:18.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.644543 11758 heartbeater.cc:344] Connected to a master server at 127.10.197.252:34729
02:13:18.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.644883 11758 heartbeater.cc:461] Registering TS with master...
02:13:18.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.645560 11760 heartbeater.cc:507] Master 127.10.197.254:45017 requested a full tablet report, sending...
02:13:18.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.645741 11759 heartbeater.cc:344] Connected to a master server at 127.10.197.253:35437
02:13:18.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.646035 11758 heartbeater.cc:507] Master 127.10.197.252:34729 requested a full tablet report, sending...
02:13:18.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.646153 11759 heartbeater.cc:461] Registering TS with master...
02:13:18.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.647079 11759 heartbeater.cc:507] Master 127.10.197.253:35437 requested a full tablet report, sending...
02:13:18.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.649616 11076 ts_manager.cc:194] Registered new tserver with Master: 16ffd0429cff4633ac4bb179de62687b (127.10.197.195:45361)
02:13:18.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.649686 11152 ts_manager.cc:194] Registered new tserver with Master: 16ffd0429cff4633ac4bb179de62687b (127.10.197.195:45361)
02:13:18.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.650765 11236 ts_manager.cc:194] Registered new tserver with Master: 16ffd0429cff4633ac4bb179de62687b (127.10.197.195:45361)
02:13:18.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.652264 11236 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.197.195:39561
02:13:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.672369 11031 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:13:18.684 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:13:18.684 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:13:18.687 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.197.254"
      port: 45017
    }
    bound_http_address {
      host: "127.10.197.254"
      port: 37981
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.197.253"
      port: 35437
    }
    bound_http_address {
      host: "127.10.197.253"
      port: 34959
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.197.252"
      port: 34729
    }
    bound_http_address {
      host: "127.10.197.252"
      port: 35255
    }
  }
}

02:13:18.688 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:13:18.690 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.197.193"
      port: 46467
    }
    bound_http_address {
      host: "127.10.197.193"
      port: 46675
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.197.194"
      port: 37229
    }
    bound_http_address {
      host: "127.10.197.194"
      port: 34643
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.197.195"
      port: 45361
    }
    bound_http_address {
      host: "127.10.197.195"
      port: 34513
    }
  }
}

02:13:18.690 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:13:18.692 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:13:18.695 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:13:18.697 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:18.698 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.197.254:45017(127.10.197.254:45017)] connecting to peer
02:13:18.699 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.197.252:34729(127.10.197.252:34729)] Successfully connected to peer
02:13:18.700 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.197.253:35437(127.10.197.253:35437)] connecting to peer
02:13:18.701 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.197.254:45017(127.10.197.254:45017)] Successfully connected to peer
02:13:18.703 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.10.197.252
02:13:18.705 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.10.197.254
02:13:18.712 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.197.253:35437(127.10.197.253:35437)] Successfully connected to peer
02:13:18.715 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.10.197.253
02:13:18.726 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xf8c20f30, L:/127.0.0.1:38692 - R:/127.10.197.252:34729] using SASL/PLAIN
02:13:18.727 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xece66ae6, L:/127.0.0.1:50944 - R:/127.10.197.254:45017] using SASL/PLAIN
02:13:18.734 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:13:18.735 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=38), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: OK, deferred=null) after lookup
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.737567 11236 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38692:
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=SCAN_TABLE"
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:13:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:18.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:13:18.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:18.741927 11236 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=SCAN_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:13:18.742 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xff916be5, L:/127.0.0.1:42552 - R:/127.10.197.253:35437] using SASL/PLAIN
02:13:18.778 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6f72a546e74720b54271bc55b18044
02:13:18.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.804832 11411 tablet_service.cc:1511] Processing CreateTablet for tablet d4e31903f1df4b238bc0bd7337b14d1f (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=8d6f72a546e74720b54271bc55b18044]), partition=RANGE (key) PARTITION UNBOUNDED
02:13:18.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.806363 11411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e31903f1df4b238bc0bd7337b14d1f. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:18.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.839118 11789 tablet_bootstrap.cc:492] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: Bootstrap starting.
02:13:18.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.839243 11552 tablet_service.cc:1511] Processing CreateTablet for tablet d4e31903f1df4b238bc0bd7337b14d1f (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=8d6f72a546e74720b54271bc55b18044]), partition=RANGE (key) PARTITION UNBOUNDED
02:13:18.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.841856 11552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e31903f1df4b238bc0bd7337b14d1f. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.845057 11693 tablet_service.cc:1511] Processing CreateTablet for tablet d4e31903f1df4b238bc0bd7337b14d1f (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=8d6f72a546e74720b54271bc55b18044]), partition=RANGE (key) PARTITION UNBOUNDED
02:13:18.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.847287 11789 tablet_bootstrap.cc:654] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: Neither blocks nor log segments found. Creating new log.
02:13:18.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.847328 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e31903f1df4b238bc0bd7337b14d1f. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:18.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.849730 11789 log.cc:826] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: Log is configured to *not* fsync() on all Append() calls
02:13:18.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.856438 11789 tablet_bootstrap.cc:492] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: No bootstrap required, opened a new log
02:13:18.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.857017 11789 ts_tablet_manager.cc:1403] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
02:13:18.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.875626 11791 tablet_bootstrap.cc:492] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: Bootstrap starting.
02:13:18.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.883443 11792 tablet_bootstrap.cc:492] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: Bootstrap starting.
02:13:18.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.883929 11791 tablet_bootstrap.cc:654] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: Neither blocks nor log segments found. Creating new log.
02:13:18.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.886427 11791 log.cc:826] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: Log is configured to *not* fsync() on all Append() calls
02:13:18.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.888810 11789 raft_consensus.cc:359] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:18.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.889658 11789 raft_consensus.cc:385] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:18.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.890048 11789 raft_consensus.cc:740] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8fe78ad53645b8af1df6ed36d5cfd7, State: Initialized, Role: FOLLOWER
02:13:18.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.891072 11789 consensus_queue.cc:260] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:18.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.892014 11792 tablet_bootstrap.cc:654] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: Neither blocks nor log segments found. Creating new log.
02:13:18.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.892800 11791 tablet_bootstrap.cc:492] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: No bootstrap required, opened a new log
02:13:18.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.893373 11791 ts_tablet_manager.cc:1403] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
02:13:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.894485 11792 log.cc:826] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: Log is configured to *not* fsync() on all Append() calls
02:13:18.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.896634 11789 ts_tablet_manager.cc:1434] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: Time spent starting tablet: real 0.039s	user 0.037s	sys 0.004s
02:13:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.919334 11792 tablet_bootstrap.cc:492] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: No bootstrap required, opened a new log
02:13:18.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.920243 11792 ts_tablet_manager.cc:1403] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.000s
02:13:18.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.925585 11791 raft_consensus.cc:359] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:18.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.926378 11791 raft_consensus.cc:385] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:18.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.926640 11791 raft_consensus.cc:740] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39152289de284ce6a2d1ec1526f1e0e0, State: Initialized, Role: FOLLOWER
02:13:18.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.927667 11791 consensus_queue.cc:260] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:18.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.938006 11791 ts_tablet_manager.cc:1434] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: Time spent starting tablet: real 0.044s	user 0.034s	sys 0.012s
02:13:18.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.945487 11792 raft_consensus.cc:359] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:18.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.946861 11792 raft_consensus.cc:385] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:18.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.947350 11792 raft_consensus.cc:740] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ffd0429cff4633ac4bb179de62687b, State: Initialized, Role: FOLLOWER
02:13:18.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.948489 11792 consensus_queue.cc:260] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:18.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.952435 11758 heartbeater.cc:499] Master 127.10.197.252:34729 was elected leader, sending a full tablet report...
02:13:18.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:18.953078 11792 ts_tablet_manager.cc:1434] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: Time spent starting tablet: real 0.032s	user 0.018s	sys 0.012s
02:13:19.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:19.004463 11483 tablet.cc:2406] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:19.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.009763 11794 raft_consensus.cc:493] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:13:19.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.010421 11794 raft_consensus.cc:515] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:19.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.013111 11794 leader_election.cc:290] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16ffd0429cff4633ac4bb179de62687b (127.10.197.195:45361), 39152289de284ce6a2d1ec1526f1e0e0 (127.10.197.194:37229)
02:13:19.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.029887 11713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e31903f1df4b238bc0bd7337b14d1f" candidate_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ffd0429cff4633ac4bb179de62687b" is_pre_election: true
02:13:19.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.030788 11713 raft_consensus.cc:2468] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be8fe78ad53645b8af1df6ed36d5cfd7 in term 0.
02:13:19.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.031549 11572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e31903f1df4b238bc0bd7337b14d1f" candidate_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39152289de284ce6a2d1ec1526f1e0e0" is_pre_election: true
02:13:19.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.032065 11366 leader_election.cc:304] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16ffd0429cff4633ac4bb179de62687b, be8fe78ad53645b8af1df6ed36d5cfd7; no voters: 
02:13:19.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.032464 11572 raft_consensus.cc:2468] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be8fe78ad53645b8af1df6ed36d5cfd7 in term 0.
02:13:19.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.032918 11794 raft_consensus.cc:2804] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:13:19.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.033305 11794 raft_consensus.cc:493] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:13:19.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.033687 11794 raft_consensus.cc:3060] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 0 FOLLOWER]: Advancing to term 1
02:13:19.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.038895 11794 raft_consensus.cc:515] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.040733 11794 leader_election.cc:290] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [CANDIDATE]: Term 1 election: Requested vote from peers 16ffd0429cff4633ac4bb179de62687b (127.10.197.195:45361), 39152289de284ce6a2d1ec1526f1e0e0 (127.10.197.194:37229)
02:13:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.041661 11713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e31903f1df4b238bc0bd7337b14d1f" candidate_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16ffd0429cff4633ac4bb179de62687b"
02:13:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.041895 11572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e31903f1df4b238bc0bd7337b14d1f" candidate_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39152289de284ce6a2d1ec1526f1e0e0"
02:13:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.042227 11713 raft_consensus.cc:3060] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [term 0 FOLLOWER]: Advancing to term 1
02:13:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.042513 11572 raft_consensus.cc:3060] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [term 0 FOLLOWER]: Advancing to term 1
02:13:19.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.047185 11713 raft_consensus.cc:2468] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be8fe78ad53645b8af1df6ed36d5cfd7 in term 1.
02:13:19.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.047261 11572 raft_consensus.cc:2468] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be8fe78ad53645b8af1df6ed36d5cfd7 in term 1.
02:13:19.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.048424 11364 leader_election.cc:304] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39152289de284ce6a2d1ec1526f1e0e0, be8fe78ad53645b8af1df6ed36d5cfd7; no voters: 
02:13:19.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.049155 11794 raft_consensus.cc:2804] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 1 FOLLOWER]: Leader election won for term 1
02:13:19.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.050844 11794 raft_consensus.cc:697] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [term 1 LEADER]: Becoming Leader. State: Replica: be8fe78ad53645b8af1df6ed36d5cfd7, State: Running, Role: LEADER
02:13:19.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.052186 11794 consensus_queue.cc:237] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } }
02:13:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.065026 11235 catalog_manager.cc:5697] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to be8fe78ad53645b8af1df6ed36d5cfd7 (127.10.197.193). New cstate: current_term: 1 leader_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8fe78ad53645b8af1df6ed36d5cfd7" member_type: VOTER last_known_addr { host: "127.10.197.193" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 } health_report { overall_health: UNKNOWN } } }
02:13:19.104 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d6f72a546e74720b54271bc55b18044
02:13:19.105 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.10.197.252:34729
02:13:19.105 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:13:19.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.106158 11031 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11191
02:13:19.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:19.124538 11765 tablet.cc:2406] T d4e31903f1df4b238bc0bd7337b14d1f P 16ffd0429cff4633ac4bb179de62687b: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:19.133 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.197.252:34729(127.10.197.252:34729)] handling channelInactive
02:13:19.133 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state READY due to: connection closed
02:13:19.135 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:13:19.136 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.138 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.138 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.139 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.10.197.252:34729(127.10.197.252:34729) for tablet Kudu Master: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.158 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.166 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.168 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.169 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.169 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:19.175987 11624 tablet.cc:2406] T d4e31903f1df4b238bc0bd7337b14d1f P 39152289de284ce6a2d1ec1526f1e0e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:19.178 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.180 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.181 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.181 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.186 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.197 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.204 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.205 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.205 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.205 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.218 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.220 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.220 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.220 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.226 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.257 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.259 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.259 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.259 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.263 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.338 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.340 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.342 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.342 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.343 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.378 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.380 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.380 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.380 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.382 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.502805 11794 consensus_queue.cc:1048] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16ffd0429cff4633ac4bb179de62687b" member_type: VOTER last_known_addr { host: "127.10.197.195" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:13:19.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:19.533193 11758 heartbeater.cc:646] Failed to heartbeat to 127.10.197.252:34729 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:19.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:19.534389 11800 consensus_queue.cc:1048] T d4e31903f1df4b238bc0bd7337b14d1f P be8fe78ad53645b8af1df6ed36d5cfd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39152289de284ce6a2d1ec1526f1e0e0" member_type: VOTER last_known_addr { host: "127.10.197.194" port: 37229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:13:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:19.537912 11476 heartbeater.cc:646] Failed to heartbeat to 127.10.197.252:34729 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:19.555702 11617 heartbeater.cc:646] Failed to heartbeat to 127.10.197.252:34729 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:19.597 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.599 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.599 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.600 [INFO - pool-10-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.606 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:19.718 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:19.719 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.719 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.720 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:19.722 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:20.457 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:20.459 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:20.459 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:20.459 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:20.463 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437; will retry
02:13:20.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.582726 11824 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d23a1b261b14f9fb206017eb32b3df5)
02:13:20.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.583148 11825 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d23a1b261b14f9fb206017eb32b3df5)
02:13:20.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.583389 11824 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:20.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.583760 11825 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:20.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.586234 11825 leader_election.cc:290] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75d3a0fdc44749a7a955c46eb8d96f22 (127.10.197.254:45017), 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729)
02:13:20.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.586978 11160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f0d59417ae354446806c5e9b85fd7ad4" is_pre_election: true
02:13:20.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.587733 11160 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75d3a0fdc44749a7a955c46eb8d96f22 in term 1.
02:13:20.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.588501 11086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0d59417ae354446806c5e9b85fd7ad4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" is_pre_election: true
02:13:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.589483 11063 leader_election.cc:304] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75d3a0fdc44749a7a955c46eb8d96f22, f0d59417ae354446806c5e9b85fd7ad4; no voters: 
02:13:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.589534 11086 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0d59417ae354446806c5e9b85fd7ad4 in term 1.
02:13:20.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.592124 11824 leader_election.cc:290] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0d59417ae354446806c5e9b85fd7ad4 (127.10.197.253:35437), 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729)
02:13:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.592875 11824 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:13:20.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.593225 11824 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d23a1b261b14f9fb206017eb32b3df5)
02:13:20.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.593658 11824 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 1 FOLLOWER]: Advancing to term 2
02:13:20.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:20.599807 11135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111) [suppressed 7 similar messages]
02:13:20.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.603802 11824 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:20.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:20.604985 11060 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111) [suppressed 11 similar messages]
02:13:20.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.607041 11160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f0d59417ae354446806c5e9b85fd7ad4"
02:13:20.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.607635 11824 leader_election.cc:290] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [CANDIDATE]: Term 2 election: Requested vote from peers f0d59417ae354446806c5e9b85fd7ad4 (127.10.197.253:35437), 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729)
02:13:20.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.607656 11160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 1 FOLLOWER]: Advancing to term 2
02:13:20.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.609226 11135 leader_election.cc:304] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75d3a0fdc44749a7a955c46eb8d96f22, f0d59417ae354446806c5e9b85fd7ad4; no voters: 
02:13:20.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:20.610500 11135 leader_election.cc:336] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729): Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:20.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:20.610814 11060 leader_election.cc:336] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729): Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:20.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:20.613994 11060 leader_election.cc:336] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729): Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111)
02:13:20.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.615307 11160 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75d3a0fdc44749a7a955c46eb8d96f22 in term 2.
02:13:20.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.615715 11825 raft_consensus.cc:2764] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
02:13:20.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.616576 11063 leader_election.cc:304] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75d3a0fdc44749a7a955c46eb8d96f22, f0d59417ae354446806c5e9b85fd7ad4; no voters: 1d23a1b261b14f9fb206017eb32b3df5
02:13:20.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.617489 11824 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 2 FOLLOWER]: Leader election won for term 2
02:13:20.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.618183 11824 raft_consensus.cc:697] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [term 2 LEADER]: Becoming Leader. State: Replica: 75d3a0fdc44749a7a955c46eb8d96f22, State: Running, Role: LEADER
02:13:20.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.619386 11824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } }
02:13:20.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.625216 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75d3a0fdc44749a7a955c46eb8d96f22. Latest consensus state: current_term: 2 leader_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:20.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.626122 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: This master's current role is: LEADER
02:13:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.627869 11832 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:13:20.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.634821 11832 catalog_manager.cc:679] Loaded metadata for table TestMasterFailover-killBefore=SCAN_TABLE [id=8d6f72a546e74720b54271bc55b18044]
02:13:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.640101 11832 tablet_loader.cc:96] loaded metadata for tablet d4e31903f1df4b238bc0bd7337b14d1f (table TestMasterFailover-killBefore=SCAN_TABLE [id=8d6f72a546e74720b54271bc55b18044])
02:13:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.641320 11832 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:13:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.644486 11832 catalog_manager.cc:1295] Loaded cluster ID: 4e08229020d44fd58d1cb40dd704a033
02:13:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.644779 11832 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:13:20.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.648347 11832 catalog_manager.cc:1540] Loading token signing keys...
02:13:20.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.651458 11832 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22: Loaded TSK: 0
02:13:20.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:20.652752 11832 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:13:21.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:21.053648 11060 consensus_peers.cc:597] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 -> Peer 1d23a1b261b14f9fb206017eb32b3df5 (127.10.197.252:34729): Couldn't send request to peer 1d23a1b261b14f9fb206017eb32b3df5. Status: Network error: Client connection negotiation failed: client connection to 127.10.197.252:34729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:13:21.078 [DEBUG - pool-10-thread-1] (Connection.java:748) [peer master-127.10.197.252:34729(127.10.197.252:34729)] connecting to peer
02:13:21.079 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:21.079 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.197.252:34729(127.10.197.252:34729)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:21.080 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.197.252:34729: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729
02:13:21.084 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:13:21.085 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=30000, elapsed=1948), Traces: [0ms] sending RPC to server master-127.10.197.252:34729, [3ms] received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [21ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [28ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [30ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [32ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [33ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [41ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [45ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [49ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [50ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [51ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [67ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [69ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [69ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [81ms] refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [84ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [87ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [89ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [90ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [123ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [126ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [127ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [127ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [201ms] refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [206ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [206ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [207ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [241ms] refreshing cache from master, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [244ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [246ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [246ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [246ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [461ms] refreshing cache from master, [461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [463ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [464ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [468ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [470ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [471ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [581ms] refreshing cache from master, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [584ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [586ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [586ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [586ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1320ms] refreshing cache from master, [1321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [1323ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1324ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [1327ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [1327ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [1328ms] delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1941ms] refreshing cache from master, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [1942ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [1943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [1943ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1946ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [1947ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, deferred=Deferred@620973656(state=PENDING, result=null, callback=get tablet locations from the master for table TestMasterFailover-killBefore=SCAN_TABLE -> release master lookup permit -> retry RPC -> scanner opened -> passthrough -> org.apache.kudu.test.ClientTestUtil$2@7c82e3b7 -> wakeup thread Time-limited test -> (continuation of Deferred@567449638 after retry RPC after error@1045911256) -> (continuation of Deferred@18460356 after retry RPC after error@1785555467) -> (continuation of Deferred@1607191752 after retry RPC after error@1538175103) -> (continuation of Deferred@386746944 after retry RPC after error@380716952) -> (continuation of Deferred@387806218 after retry RPC after error@966656990) -> (continuation of Deferred@1153176039 after retry RPC after error@1479349103) -> (continuation of Deferred@619479364 after retry RPC after error@1839593204) -> (continuation of Deferred@1228075406 after retry RPC after error@2041849260) -> (continuation of Deferred@957508991 after retry RPC after error@2076323583) -> (continuation of Deferred@631377544 after retry RPC after error@2112083669), errback=passthrough -> release master lookup permit -> retry RPC after error -> passthrough -> open scanner errback -> org.apache.kudu.test.ClientTestUtil$1@57302583 -> wakeup thread Time-limited test -> (continuation of Deferred@567449638 after retry RPC after error@1045911256) -> (continuation of Deferred@18460356 after retry RPC after error@1785555467) -> (continuation of Deferred@1607191752 after retry RPC after error@1538175103) -> (continuation of Deferred@386746944 after retry RPC after error@380716952) -> (continuation of Deferred@387806218 after retry RPC after error@966656990) -> (continuation of Deferred@1153176039 after retry RPC after error@1479349103) -> (continuation of Deferred@619479364 after retry RPC after error@1839593204) -> (continuation of Deferred@1228075406 after retry RPC after error@2041849260) -> (continuation of Deferred@957508991 after retry RPC after error@2076323583) -> (continuation of Deferred@631377544 after retry RPC after error@2112083669))) after lookup
02:13:21.092 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet d4e31903f1df4b238bc0bd7337b14d1f for table 'TestMasterFailover-killBefore=SCAN_TABLE' with partition [<start>, <end>)
02:13:21.093 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d4e31903f1df4b238bc0bd7337b14d1f@[16ffd0429cff4633ac4bb179de62687b(127.10.197.195:45361),39152289de284ce6a2d1ec1526f1e0e0(127.10.197.194:37229),be8fe78ad53645b8af1df6ed36d5cfd7(127.10.197.193:46467)[L]]}]
02:13:21.093 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=1957), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.197.252:34729, [4ms] Sub RPC GetTableLocations: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [4ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [22ms] Sub RPC GetTableLocations: refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [29ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [33ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [34ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [46ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [50ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [51ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [64ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [68ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [69ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [70ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [70ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [82ms] Sub RPC GetTableLocations: refreshing cache from master, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [84ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [85ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [88ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [90ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [91ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [122ms] Sub RPC GetTableLocations: refreshing cache from master, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [123ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [124ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [127ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [128ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [128ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [202ms] Sub RPC GetTableLocations: refreshing cache from master, [203ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [204ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [207ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [208ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [208ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [242ms] Sub RPC GetTableLocations: refreshing cache from master, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [243ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [244ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [245ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [247ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [247ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [247ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [462ms] Sub RPC GetTableLocations: refreshing cache from master, [462ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [464ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [465ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [469ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [471ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [472ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [582ms] Sub RPC GetTableLocations: refreshing cache from master, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [584ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [585ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [587ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [587ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [587ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1321ms] Sub RPC GetTableLocations: refreshing cache from master, [1322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [1323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [1324ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1325ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [1328ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [1328ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [1329ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.197.252:34729,127.10.197.254:45017,127.10.197.253:35437) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1942ms] Sub RPC GetTableLocations: refreshing cache from master, [1943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.252:34729, [1943ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.254:45017, [1944ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.197.253:35437, [1944ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.252:34729: Network error: Failed to connect to peer master-127.10.197.252:34729(127.10.197.252:34729): Connection refused: /127.10.197.252:34729, [1947ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.253:35437: OK, [1948ms] Sub RPC ConnectToMaster: received response from server master-127.10.197.254:45017: OK, [1952ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.197.254:45017, [1957ms] Sub RPC GetTableLocations: received response from server master-127.10.197.254:45017: OK, deferred=null)) after lookup
02:13:21.095 [DEBUG - kudu-nio-1] (Connection.java:748) [peer be8fe78ad53645b8af1df6ed36d5cfd7(127.10.197.193:46467)] connecting to peer
02:13:21.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.095079 11160 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [term 2 FOLLOWER]: Refusing update from remote peer 75d3a0fdc44749a7a955c46eb8d96f22: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:13:21.097 [DEBUG - kudu-nio-7] (Connection.java:757) [peer be8fe78ad53645b8af1df6ed36d5cfd7(127.10.197.193:46467)] Successfully connected to peer
02:13:21.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.097519 11828 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
02:13:21.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.102454 11825 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75d3a0fdc44749a7a955c46eb8d96f22. Latest consensus state: current_term: 2 leader_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:21.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.104364 11825 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: This master's current role is: FOLLOWER
02:13:21.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.110126 11824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:21.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.111814 11824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75d3a0fdc44749a7a955c46eb8d96f22 [sys.catalog]: This master's current role is: LEADER
02:13:21.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.113282 11825 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75d3a0fdc44749a7a955c46eb8d96f22" member_type: VOTER last_known_addr { host: "127.10.197.254" port: 45017 } } peers { permanent_uuid: "f0d59417ae354446806c5e9b85fd7ad4" member_type: VOTER last_known_addr { host: "127.10.197.253" port: 35437 } } peers { permanent_uuid: "1d23a1b261b14f9fb206017eb32b3df5" member_type: VOTER last_known_addr { host: "127.10.197.252" port: 34729 } } }
02:13:21.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.114085 11825 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d59417ae354446806c5e9b85fd7ad4 [sys.catalog]: This master's current role is: FOLLOWER
02:13:21.127 [DEBUG - kudu-nio-7] (Negotiator.java:918) Authenticated connection [id: 0x682080e0, L:/127.0.0.1:43776 - R:/127.10.197.193:46467] using TOKEN/null
02:13:21.139 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=SCAN_TABLE, tablet=d4e31903f1df4b238bc0bd7337b14d1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:13:21.140 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:13:21.143 [DEBUG - main] (Connection.java:575) [peer master-127.10.197.253:35437(127.10.197.253:35437)] disconnecting while in state READY
02:13:21.143 [DEBUG - main] (Connection.java:575) [peer master-127.10.197.254:45017(127.10.197.254:45017)] disconnecting while in state READY
02:13:21.143 [DEBUG - main] (Connection.java:575) [peer master-127.10.197.252:34729(127.10.197.252:34729)] disconnecting while in state TERMINATED
02:13:21.144 [DEBUG - main] (Connection.java:575) [peer be8fe78ad53645b8af1df6ed36d5cfd7(127.10.197.193:46467)] disconnecting while in state READY
02:13:21.144 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.197.253:35437(127.10.197.253:35437)] handling channelInactive
02:13:21.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.197.253:35437(127.10.197.253:35437)] cleaning up while in state READY due to: connection closed
02:13:21.144 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.197.254:45017(127.10.197.254:45017)] handling channelInactive
02:13:21.144 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.197.254:45017(127.10.197.254:45017)] cleaning up while in state READY due to: connection closed
02:13:21.145 [DEBUG - kudu-nio-7] (Connection.java:239) [peer be8fe78ad53645b8af1df6ed36d5cfd7(127.10.197.193:46467)] handling channelInactive
02:13:21.145 [DEBUG - kudu-nio-7] (Connection.java:709) [peer be8fe78ad53645b8af1df6ed36d5cfd7(127.10.197.193:46467)] cleaning up while in state READY due to: connection closed
02:13:21.146 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:13:21.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.149933 11031 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11316
02:13:21.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.184248 11031 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11486
02:13:21.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.212996 11031 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11627
02:13:21.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.240085 11031 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11043
02:13:21.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:21.270604 11031 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11113
02:13:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:22Z chronyd exiting
.02:13:23.535 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783476803535
02:13:23.538 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:13:23.539 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:13:23.539 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskdJk2H7/test-tmp
02:13:23.539 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:13:23.539 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskdJk2H7/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:13:23.542 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:13:23.872 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:13:23.872 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:13:23.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:23.876091 11851 mini_oidc.cc:150] Starting JWKS server
02:13:23.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:23.879307 11851 webserver.cc:533] Webserver started at http://127.0.0.1:44353/ using document root <none> and password file <none>
02:13:23.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:23.879751 11851 mini_oidc.cc:186] Starting OIDC Discovery server
02:13:23.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:23.881798 11851 webserver.cc:533] Webserver started at http://127.0.0.1:35001/ using document root <none> and password file <none>
02:13:23.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:23Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:13:23.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:23Z Disabled control of system clock
02:13:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:23.947192 11851 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:23.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/logs
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data/info.pb
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.254:46623
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.254
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:23.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44353/jwks.json with env {}
02:13:24.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.260816 11863 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:24.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.261483 11863 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:24.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.262117 11863 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.296368 11863 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:13:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.296706 11863 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.296916 11863 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:13:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.297124 11863 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:13:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.297324 11863 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:13:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.297474 11863 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44353/jwks.json
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:24.335781 11863 master_runner.cc:387] Master server non-default flags:
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.254:46623
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44353/jwks.json
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data/info.pb
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.254
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/logs
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:24.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:24.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:24.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:24.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:24.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:24.337142 11863 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:24.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:24.338958 11863 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:24.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.351508 11869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:25.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:24.352074 11870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:25.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.626132 11872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:25.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.629989 11871 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1276 milliseconds
02:13:25.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.630707 11863 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.280s	user 0.418s	sys 0.860s
02:13:25.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.630987 11863 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.280s	user 0.418s	sys 0.860s
02:13:25.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.631170 11863 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:25.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.632248 11863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:25.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.634974 11863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:25.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.636391 11863 hybrid_clock.cc:648] HybridClock initialized: now 1783476805636343 us; error 58 us; skew 500 ppm
02:13:25.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.637315 11863 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:25.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.645134 11863 webserver.cc:533] Webserver started at http://127.11.146.254:34903/ using document root <none> and password file <none>
02:13:25.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.646433 11863 fs_manager.cc:362] Metadata directory not provided
02:13:25.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.646723 11863 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:25.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.647161 11863 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.651674 11863 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data/instance:
02:13:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "092efe4d06714d8085c4b32ec2152d8c"
02:13:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:25 on dist-test-slave-3kxw"
02:13:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.652799 11863 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal/instance:
02:13:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "092efe4d06714d8085c4b32ec2152d8c"
02:13:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:25 on dist-test-slave-3kxw"
02:13:25.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.661222 11863 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
02:13:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.667680 11879 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:25.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.669028 11863 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
02:13:25.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.669458 11863 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal
02:13:25.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "092efe4d06714d8085c4b32ec2152d8c"
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:25 on dist-test-slave-3kxw"
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.669890 11863 fs_report.cc:389] FS layout report
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data/data
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:25.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.738451 11863 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.740154 11863 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.740710 11863 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:25.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.814160 11863 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.254:46623
02:13:25.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.814249 11931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.146.254:46623 every 8 connection(s)
02:13:25.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.817060 11863 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/data/info.pb
02:13:25.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.818225 11851 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11863
02:13:25.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.818665 11851 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-0/wal/instance
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.822868 11851 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/logs
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data/info.pb
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.253:34775
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.253
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44353/jwks.json with env {}
02:13:25.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.824568 11932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:25.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.835338 11932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } has no permanent_uuid. Determining permanent_uuid...
02:13:25.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.868543 11932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } has no permanent_uuid. Determining permanent_uuid...
02:13:25.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.871120 11880 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:25.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.875837 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:25.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.925380 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 1
02:13:25.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:25.930994 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:26.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:25.999491 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 2
02:13:26.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.004830 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:26.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:26.096342 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 3
02:13:26.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.100805 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:26.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.149504 11934 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:26.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.150197 11934 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:26.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.150729 11934 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:26.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.183884 11934 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:13:26.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.184177 11934 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:26.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.184365 11934 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:13:26.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.184547 11934 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:13:26.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.184763 11934 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:13:26.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.184906 11934 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44353/jwks.json
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:26.223223 11934 master_runner.cc:387] Master server non-default flags:
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:26.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.253:34775
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44353/jwks.json
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data/info.pb
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.253
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/logs
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:26.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:26.224596 11934 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:26.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:26.226262 11934 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:26.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.237150 11943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:26.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:26.244290 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 4
02:13:26.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.251693 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:26.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:26.551179 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 5
02:13:26.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.560398 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:27.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.108038 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 6
02:13:27.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.133634 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.253:34775: Network error: Client connection negotiation failed: client connection to 127.11.146.253:34775: connect: Connection refused (error 111)
02:13:27.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.642637 11942 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 11934
02:13:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.715772 11942 kernel_stack_watchdog.cc:198] Thread 11934 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
02:13:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:13:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:13:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:13:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:13:27.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:26.239450 11944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:27.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.716926 11945 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1476 milliseconds
02:13:27.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.717234 11934 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.479s	user 0.002s	sys 0.000s
02:13:27.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.717681 11934 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.479s	user 0.002s	sys 0.001s
02:13:27.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.719594 11946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:27.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.719506 11934 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:27.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.722695 11934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:27.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.725221 11934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:27.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.726608 11934 hybrid_clock.cc:648] HybridClock initialized: now 1783476807726573 us; error 41 us; skew 500 ppm
02:13:27.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.727514 11934 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:27.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.733727 11934 webserver.cc:533] Webserver started at http://127.11.146.253:38963/ using document root <none> and password file <none>
02:13:27.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.734823 11934 fs_manager.cc:362] Metadata directory not provided
02:13:27.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.735081 11934 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:27.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.735621 11934 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:27.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.739974 11934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data/instance:
02:13:27.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "58968e6e34c44271a2000dbbdb1ffe77"
02:13:27.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:27 on dist-test-slave-3kxw"
02:13:27.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.741328 11934 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal/instance:
02:13:27.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "58968e6e34c44271a2000dbbdb1ffe77"
02:13:27.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:27 on dist-test-slave-3kxw"
02:13:27.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.748898 11934 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
02:13:27.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.755030 11955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:27.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.756167 11934 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
02:13:27.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.756553 11934 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "58968e6e34c44271a2000dbbdb1ffe77"
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:27 on dist-test-slave-3kxw"
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.756938 11934 fs_report.cc:389] FS layout report
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data/data
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:27.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:27.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:27.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:27.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:27.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.805457 11934 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:27.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.807142 11934 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:27.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.807689 11934 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:27.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.884845 11934 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.253:34775
02:13:27.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.884927 12006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.146.253:34775 every 8 connection(s)
02:13:27.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.887801 11934 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/data/info.pb
02:13:27.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.892493 11851 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 11934
02:13:27.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.892900 11851 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-1/wal/instance
02:13:27.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.894403 12007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.894932 11851 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/logs
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data/info.pb
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:27.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.252:34793
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.252
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:27.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44353/jwks.json with env {}
02:13:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.910326 12007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } has no permanent_uuid. Determining permanent_uuid...
02:13:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.935549 12007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } has no permanent_uuid. Determining permanent_uuid...
02:13:27.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:27.951570 12007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } has no permanent_uuid. Determining permanent_uuid...
02:13:27.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.954591 11959 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:27.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:27.959410 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.008958 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 1
02:13:28.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.014366 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.082815 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 2
02:13:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.087867 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.179311 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 3
02:13:28.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.184883 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.194265 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } attempt: 7
02:13:28.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.206957 11932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } has no permanent_uuid. Determining permanent_uuid...
02:13:28.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.213384 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.225203 12009 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:28.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.225772 12009 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:28.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.226344 12009 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:28.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.260228 12009 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:13:28.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.260526 12009 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:28.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.260718 12009 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:13:28.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.260917 12009 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:13:28.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.261106 12009 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:13:28.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.261260 12009 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44353/jwks.json
02:13:28.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.271840 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 1
02:13:28.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.276708 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.300441 12009 master_runner.cc:387] Master server non-default flags:
02:13:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.252:34793
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44353/jwks.json
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data/info.pb
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.252
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/logs
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.301811 12009 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:28.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.304167 12009 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:28.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.320050 12022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:28.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.328281 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 4
02:13:28.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.335002 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.358155 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 2
02:13:28.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.365948 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.451551 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 3
02:13:28.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.459944 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.600566 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 4
02:13:28.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.608022 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.634513 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 5
02:13:28.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.642262 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:28.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:28.891651 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 5
02:13:28.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.900591 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:29.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.189939 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 6
02:13:29.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.202294 12007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:29.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.453188 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 6
02:13:29.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.465231 11932 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.146.252:34793: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:29.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:28.322041 12023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:29.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.602653 12009 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.285s	user 0.406s	sys 0.878s
02:13:29.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.603013 12009 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.285s	user 0.406s	sys 0.878s
02:13:29.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.604417 12009 server_base.cc:1061] running on GCE node
02:13:29.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.606220 12031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:29.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.607785 12009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:29.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.611080 12009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:29.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.612766 12009 hybrid_clock.cc:648] HybridClock initialized: now 1783476809612715 us; error 44 us; skew 500 ppm
02:13:29.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.614056 12009 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.623534 12009 webserver.cc:533] Webserver started at http://127.11.146.252:40499/ using document root <none> and password file <none>
02:13:29.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.624993 12009 fs_manager.cc:362] Metadata directory not provided
02:13:29.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.625326 12009 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:29.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.626003 12009 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.630522 12009 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data/instance:
02:13:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3faba6bf119a438183d1fd7f3c231a56"
02:13:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:29 on dist-test-slave-3kxw"
02:13:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.631628 12009 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal/instance:
02:13:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3faba6bf119a438183d1fd7f3c231a56"
02:13:29.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:29 on dist-test-slave-3kxw"
02:13:29.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.640024 12009 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
02:13:29.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.646485 12036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:29.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.647886 12009 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
02:13:29.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.648344 12009 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal
02:13:29.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3faba6bf119a438183d1fd7f3c231a56"
02:13:29.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:29 on dist-test-slave-3kxw"
02:13:29.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.648697 12009 fs_report.cc:389] FS layout report
02:13:29.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:29.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal
02:13:29.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal
02:13:29.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data/data
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:29.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:29.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.742939 12009 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:29.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.744575 12009 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:29.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.745733 12009 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:29.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.833999 12009 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.252:34793
02:13:29.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.834131 12088 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.146.252:34793 every 8 connection(s)
02:13:29.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.836694 12009 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/data/info.pb
02:13:29.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.842607 12089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:29.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.842541 11851 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 12009
02:13:29.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.843019 11851 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/master-2/wal/instance
02:13:29.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.856606 12089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } has no permanent_uuid. Determining permanent_uuid...
02:13:29.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.886021 12089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } has no permanent_uuid. Determining permanent_uuid...
02:13:29.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.898840 12089 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } has no permanent_uuid. Determining permanent_uuid...
02:13:29.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.916720 12089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: Bootstrap starting.
02:13:29.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.923725 12089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: Neither blocks nor log segments found. Creating new log.
02:13:29.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.925557 12089 log.cc:826] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: Log is configured to *not* fsync() on all Append() calls
02:13:29.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.930605 12089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: No bootstrap required, opened a new log
02:13:29.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.949170 12089 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.949868 12089 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:29.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.950170 12089 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3faba6bf119a438183d1fd7f3c231a56, State: Initialized, Role: FOLLOWER
02:13:29.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.951175 12089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:29.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.953888 12098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:29.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.954545 12098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: This master's current role is: FOLLOWER
02:13:29.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.955529 12089 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: configured and running, proceeding with master startup.
02:13:29.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.983139 12109 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:13:29.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:29.983526 12109 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:13:30.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:29.980674 12009 master_runner.cc:187] Error getting master registration for 127.11.146.254:46623: OK, instance_id { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" instance_seqno: 1783476805794323 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:13:30.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.002694 12009 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:13:30.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:30.002910 12042 tablet.cc:2406] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:30.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.263634 12007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 7
02:13:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.281198 12007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: Bootstrap starting.
02:13:30.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.288288 12007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: Neither blocks nor log segments found. Creating new log.
02:13:30.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.290130 12007 log.cc:826] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: Log is configured to *not* fsync() on all Append() calls
02:13:30.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.294770 12007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: No bootstrap required, opened a new log
02:13:30.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.312827 12007 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.313529 12007 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:30.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.313916 12007 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58968e6e34c44271a2000dbbdb1ffe77, State: Initialized, Role: FOLLOWER
02:13:30.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.314920 12007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.318171 12113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.318980 12113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: This master's current role is: FOLLOWER
02:13:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.320006 12007 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: configured and running, proceeding with master startup.
02:13:30.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.354933 12098 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:13:30.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.355505 12098 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.360453 11982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3faba6bf119a438183d1fd7f3c231a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58968e6e34c44271a2000dbbdb1ffe77" is_pre_election: true
02:13:30.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.361384 12098 leader_election.cc:290] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092efe4d06714d8085c4b32ec2152d8c (127.11.146.254:46623), 58968e6e34c44271a2000dbbdb1ffe77 (127.11.146.253:34775)
02:13:30.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.361476 11982 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3faba6bf119a438183d1fd7f3c231a56 in term 0.
02:13:30.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.363521 12037 leader_election.cc:304] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3faba6bf119a438183d1fd7f3c231a56, 58968e6e34c44271a2000dbbdb1ffe77; no voters: 
02:13:30.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.364442 12098 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:13:30.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.365126 12098 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:13:30.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.365723 12098 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 0 FOLLOWER]: Advancing to term 1
02:13:30.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:30.369475 12124 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:13:30.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:30.369887 12124 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:13:30.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.375946 12098 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.381095 11982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3faba6bf119a438183d1fd7f3c231a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58968e6e34c44271a2000dbbdb1ffe77"
02:13:30.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.381698 11982 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 0 FOLLOWER]: Advancing to term 1
02:13:30.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.345000 11934 master_runner.cc:187] Error getting master registration for 127.11.146.254:46623: OK, instance_id { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" instance_seqno: 1783476805794323 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:13:30.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.384109 11934 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:13:30.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.388988 11982 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3faba6bf119a438183d1fd7f3c231a56 in term 1.
02:13:30.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.390281 12037 leader_election.cc:304] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3faba6bf119a438183d1fd7f3c231a56, 58968e6e34c44271a2000dbbdb1ffe77; no voters: 
02:13:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.393668 12126 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 1 FOLLOWER]: Leader election won for term 1
02:13:30.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.402711 12098 leader_election.cc:290] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [CANDIDATE]: Term 1 election: Requested vote from peers 092efe4d06714d8085c4b32ec2152d8c (127.11.146.254:46623), 58968e6e34c44271a2000dbbdb1ffe77 (127.11.146.253:34775)
02:13:30.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.404212 12126 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [term 1 LEADER]: Becoming Leader. State: Replica: 3faba6bf119a438183d1fd7f3c231a56, State: Running, Role: LEADER
02:13:30.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.405727 12126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.418443 12098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3faba6bf119a438183d1fd7f3c231a56. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.419811 12098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: This master's current role is: LEADER
02:13:30.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.424721 12129 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:13:30.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.432900 12129 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:13:30.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.452589 11982 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Refusing update from remote peer 3faba6bf119a438183d1fd7f3c231a56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:13:30.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.454605 12098 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:13:30.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.484570 12113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3faba6bf119a438183d1fd7f3c231a56. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.488500 12113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: This master's current role is: FOLLOWER
02:13:30.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.498442 12126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.499269 12126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: This master's current role is: LEADER
02:13:30.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.499734 11932 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } attempt: 7
02:13:30.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.501084 12131 mvcc.cc:204] Tried to move back new op lower bound from 7305121015588798464 to 7305121015432773632. Current Snapshot: MvccSnapshot[applied={T|T < 7305121015588798464}]
02:13:30.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.510187 12129 catalog_manager.cc:1383] Generated new cluster ID: bd6b208a86974ebbae9b5905cdd304f2
02:13:30.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.510550 12129 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:13:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.537217 12113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.538051 12113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: This master's current role is: FOLLOWER
02:13:30.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.550936 11932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: Bootstrap starting.
02:13:30.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.562915 11932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: Neither blocks nor log segments found. Creating new log.
02:13:30.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.575575 11932 log.cc:826] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: Log is configured to *not* fsync() on all Append() calls
02:13:30.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.575807 12129 catalog_manager.cc:1406] Generated new certificate authority record
02:13:30.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.577904 12129 catalog_manager.cc:1540] Loading token signing keys...
02:13:30.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.589905 11932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: No bootstrap required, opened a new log
02:13:30.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.619594 12129 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56: Generated new TSK 0
02:13:30.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.620779 12129 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:13:30.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.637105 11932 raft_consensus.cc:359] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.638417 11932 raft_consensus.cc:385] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:30.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.638777 11932 raft_consensus.cc:740] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092efe4d06714d8085c4b32ec2152d8c, State: Initialized, Role: FOLLOWER
02:13:30.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.639973 11932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.647048 12138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.651273 12138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: This master's current role is: FOLLOWER
02:13:30.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.653273 11905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3faba6bf119a438183d1fd7f3c231a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092efe4d06714d8085c4b32ec2152d8c"
02:13:30.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.654533 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3faba6bf119a438183d1fd7f3c231a56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092efe4d06714d8085c4b32ec2152d8c" is_pre_election: true
02:13:30.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.661521 12137 raft_consensus.cc:493] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:13:30.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.662534 12137 raft_consensus.cc:515] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.664748 11851 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/logs
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data/info.pb
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.193:0
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.146.193
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.193
02:13:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:30.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:30.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:30.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:30.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:30.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:13:30.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.666615 11982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "092efe4d06714d8085c4b32ec2152d8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58968e6e34c44271a2000dbbdb1ffe77" is_pre_election: true
02:13:30.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.668553 11932 sys_catalog.cc:565] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: configured and running, proceeding with master startup.
02:13:30.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.673457 11904 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 0 FOLLOWER]: Advancing to term 1
02:13:30.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.674528 12063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "092efe4d06714d8085c4b32ec2152d8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3faba6bf119a438183d1fd7f3c231a56" is_pre_election: true
02:13:30.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.676710 11883 leader_election.cc:304] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092efe4d06714d8085c4b32ec2152d8c; no voters: 3faba6bf119a438183d1fd7f3c231a56, 58968e6e34c44271a2000dbbdb1ffe77
02:13:30.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.677923 12137 leader_election.cc:290] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58968e6e34c44271a2000dbbdb1ffe77 (127.11.146.253:34775), 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793)
02:13:30.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.682049 11904 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Refusing update from remote peer 3faba6bf119a438183d1fd7f3c231a56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:13:30.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.682979 12137 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
02:13:30.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.684253 12126 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:13:30.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.719897 12143 mvcc.cc:204] Tried to move back new op lower bound from 7305121015588798464 to 7305121015432773632. Current Snapshot: MvccSnapshot[applied={T|T < 7305121015588798464}]
02:13:30.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.749261 12137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3faba6bf119a438183d1fd7f3c231a56. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.749981 12137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: This master's current role is: FOLLOWER
02:13:30.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.750391 12138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:30.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.751024 12138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: This master's current role is: FOLLOWER
02:13:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.796819 12155 catalog_manager.cc:1295] Loaded cluster ID: bd6b208a86974ebbae9b5905cdd304f2
02:13:30.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.797116 12155 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: loading cluster ID for follower catalog manager: success
02:13:30.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.804849 12155 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: acquiring CA information for follower catalog manager: success
02:13:30.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:30.823032 12155 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:13:31.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.110977 12126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3faba6bf119a438183d1fd7f3c231a56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:31.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.111752 12126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3faba6bf119a438183d1fd7f3c231a56 [sys.catalog]: This master's current role is: LEADER
02:13:31.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.304147 12140 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:31.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.305146 12140 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:31.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.306123 12140 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:31.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.369786 12140 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:31.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.375823 12124 catalog_manager.cc:1295] Loaded cluster ID: bd6b208a86974ebbae9b5905cdd304f2
02:13:31.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.376457 12124 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: loading cluster ID for follower catalog manager: success
02:13:31.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.383916 12124 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: acquiring CA information for follower catalog manager: success
02:13:31.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.385646 12140 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.193
02:13:31.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.395576 12124 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.459808 12140 tablet_server_runner.cc:78] Tablet server non-default flags:
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:31.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.193:0
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data/info.pb
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.193
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.146.193
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/logs
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:31.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:31.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.463394 12140 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:31.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:31.466006 12140 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:31.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.514262 12162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:32.898290 12161 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 12140
02:13:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:33.846271 12161 kernel_stack_watchdog.cc:198] Thread 12140 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 377ms:
02:13:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:13:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:13:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:13:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:13:33.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:31.520798 12163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:33.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:33.852332 12140 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.334s	user 0.580s	sys 0.906s
02:13:33.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:33.852695 12140 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.334s	user 0.580s	sys 0.906s
02:13:33.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.867178 12140 server_base.cc:1061] running on GCE node
02:13:33.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:33.868074 12168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:33.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.869479 12140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:33.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.877919 12140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:33.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.879384 12140 hybrid_clock.cc:648] HybridClock initialized: now 1783476813879330 us; error 57 us; skew 500 ppm
02:13:33.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.880461 12140 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:33.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.899590 12140 webserver.cc:533] Webserver started at http://127.11.146.193:37997/ using document root <none> and password file <none>
02:13:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.900934 12140 fs_manager.cc:362] Metadata directory not provided
02:13:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.901233 12140 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.901777 12140 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:33.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.908277 12140 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data/instance:
02:13:33.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ae2c053301649d78a2b4b55a8923404"
02:13:33.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:33 on dist-test-slave-3kxw"
02:13:33.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.909789 12140 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal/instance:
02:13:33.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ae2c053301649d78a2b4b55a8923404"
02:13:33.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:33 on dist-test-slave-3kxw"
02:13:33.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.924562 12140 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.004s	sys 0.009s
02:13:33.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.932518 12173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:33.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.934227 12140 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.002s
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.934666 12140 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ae2c053301649d78a2b4b55a8923404"
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:33 on dist-test-slave-3kxw"
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:33.935133 12140 fs_report.cc:389] FS layout report
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal
02:13:33.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data/data
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:33.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:34.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.019786 12140 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:34.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.021523 12140 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:34.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.022050 12140 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:34.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.025022 12140 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:13:34.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.029644 12140 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:13:34.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.029918 12140 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
02:13:34.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.030279 12140 ts_tablet_manager.cc:616] Registered 0 tablets
02:13:34.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.030479 12140 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:13:34.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.208218 12140 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.193:45065
02:13:34.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.208295 12286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.146.193:45065 every 8 connection(s)
02:13:34.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.211030 12140 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/data/info.pb
02:13:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.220077 11851 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 12140
02:13:34.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.220937 11851 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-0/wal/instance
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.243783 11851 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/logs
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data/info.pb
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:34.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.194:0
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.146.194
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.194
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:34.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:13:34.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.266189 12288 heartbeater.cc:344] Connected to a master server at 127.11.146.253:34775
02:13:34.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.266814 12288 heartbeater.cc:461] Registering TS with master...
02:13:34.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.270887 12288 heartbeater.cc:507] Master 127.11.146.253:34775 requested a full tablet report, sending...
02:13:34.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.271864 12287 heartbeater.cc:344] Connected to a master server at 127.11.146.252:34793
02:13:34.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.272225 12287 heartbeater.cc:461] Registering TS with master...
02:13:34.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.273211 12287 heartbeater.cc:507] Master 127.11.146.252:34793 requested a full tablet report, sending...
02:13:34.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.275833 11972 ts_manager.cc:194] Registered new tserver with Master: 1ae2c053301649d78a2b4b55a8923404 (127.11.146.193:45065)
02:13:34.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.278400 12053 ts_manager.cc:194] Registered new tserver with Master: 1ae2c053301649d78a2b4b55a8923404 (127.11.146.193:45065)
02:13:34.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.280745 12053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.146.193:51975
02:13:34.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.281998 12289 heartbeater.cc:344] Connected to a master server at 127.11.146.254:46623
02:13:34.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.282369 12289 heartbeater.cc:461] Registering TS with master...
02:13:34.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.283605 12289 heartbeater.cc:507] Master 127.11.146.254:46623 requested a full tablet report, sending...
02:13:34.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.287108 11895 ts_manager.cc:194] Registered new tserver with Master: 1ae2c053301649d78a2b4b55a8923404 (127.11.146.193:45065)
02:13:34.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.599630 12298 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:34.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.600170 12298 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:34.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.600654 12298 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:34.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.635982 12298 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:34.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.636845 12298 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.194
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.675575 12298 tablet_server_runner.cc:78] Tablet server non-default flags:
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.194:0
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data/info.pb
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.194
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.146.194
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/logs
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:13:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.676908 12298 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:34.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:34.678609 12298 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:34.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.691828 12304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:35.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.285054 12287 heartbeater.cc:499] Master 127.11.146.252:34793 was elected leader, sending a full tablet report...
02:13:35.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.693456 12305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:35.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:34.696873 12307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:35.927978 12306 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:13:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.928031 12298 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:35.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.933139 12298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:35.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.935576 12298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:35.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.936971 12298 hybrid_clock.cc:648] HybridClock initialized: now 1783476815936926 us; error 67 us; skew 500 ppm
02:13:35.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.937867 12298 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:35.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.944311 12298 webserver.cc:533] Webserver started at http://127.11.146.194:44433/ using document root <none> and password file <none>
02:13:35.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.945250 12298 fs_manager.cc:362] Metadata directory not provided
02:13:35.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.945464 12298 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:35.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.945955 12298 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:35.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.950498 12298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data/instance:
02:13:35.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04b4b62bcf6b450f898357ac42cb7c36"
02:13:35.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:35 on dist-test-slave-3kxw"
02:13:35.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.951618 12298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal/instance:
02:13:35.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04b4b62bcf6b450f898357ac42cb7c36"
02:13:35.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:35 on dist-test-slave-3kxw"
02:13:35.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.959045 12298 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
02:13:35.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.964907 12314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.966276 12298 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
02:13:35.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.966573 12298 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04b4b62bcf6b450f898357ac42cb7c36"
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:35 on dist-test-slave-3kxw"
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:35.966922 12298 fs_report.cc:389] FS layout report
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data/data
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:35.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:36.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.029327 12298 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:36.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.030990 12298 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:36.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.031424 12298 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:36.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.034044 12298 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:13:36.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.038331 12298 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:13:36.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.038548 12298 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:13:36.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.038826 12298 ts_tablet_manager.cc:616] Registered 0 tablets
02:13:36.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.038960 12298 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:13:36.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.183168 12298 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.194:36957
02:13:36.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.183295 12428 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.146.194:36957 every 8 connection(s)
02:13:36.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.186024 12298 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/data/info.pb
02:13:36.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.196283 11851 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 12298
02:13:36.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.196841 11851 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-1/wal/instance
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.229563 11851 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/logs
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data/info.pb
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.195:0
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.146.195
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.195
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:36.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:36.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:36.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:13:36.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.247874 12430 heartbeater.cc:344] Connected to a master server at 127.11.146.253:34775
02:13:36.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.248420 12430 heartbeater.cc:461] Registering TS with master...
02:13:36.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.249958 12430 heartbeater.cc:507] Master 127.11.146.253:34775 requested a full tablet report, sending...
02:13:36.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.252246 12429 heartbeater.cc:344] Connected to a master server at 127.11.146.252:34793
02:13:36.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.252652 12429 heartbeater.cc:461] Registering TS with master...
02:13:36.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.253713 12429 heartbeater.cc:507] Master 127.11.146.252:34793 requested a full tablet report, sending...
02:13:36.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.253667 11972 ts_manager.cc:194] Registered new tserver with Master: 04b4b62bcf6b450f898357ac42cb7c36 (127.11.146.194:36957)
02:13:36.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.254050 12431 heartbeater.cc:344] Connected to a master server at 127.11.146.254:46623
02:13:36.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.254393 12431 heartbeater.cc:461] Registering TS with master...
02:13:36.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.255345 12431 heartbeater.cc:507] Master 127.11.146.254:46623 requested a full tablet report, sending...
02:13:36.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.256448 12053 ts_manager.cc:194] Registered new tserver with Master: 04b4b62bcf6b450f898357ac42cb7c36 (127.11.146.194:36957)
02:13:36.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.257903 11895 ts_manager.cc:194] Registered new tserver with Master: 04b4b62bcf6b450f898357ac42cb7c36 (127.11.146.194:36957)
02:13:36.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.258181 12053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.146.194:39213
02:13:36.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.558064 12439 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:13:36.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.558560 12439 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:13:36.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.558966 12439 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:13:36.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.594398 12439 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:13:36.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.595198 12439 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.146.195
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.632701 12439 tablet_server_runner.cc:78] Tablet server non-default flags:
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.146.212:33813
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.146.195:0
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data/info.pb
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.146.195
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.146.254:46623,127.11.146.253:34775,127.11.146.252:34793
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.146.195
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/logs
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:13:36.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:13:36.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.634125 12439 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:13:36.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:36.635746 12439 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:13:36.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.648902 12445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:37.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:37.262112 12429 heartbeater.cc:499] Master 127.11.146.252:34793 was elected leader, sending a full tablet report...
02:13:38.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:38.054817 12444 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 12439
02:13:38.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:38.065466 12439 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.417s	user 0.473s	sys 0.821s
02:13:38.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:38.065932 12439 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.417s	user 0.474s	sys 0.821s
02:13:38.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:36.649500 12446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:38.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:38.067765 12448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:38.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:38.071491 12447 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1416 milliseconds
02:13:38.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.071504 12439 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:38.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.072791 12439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:38.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.074987 12439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:38.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.076398 12439 hybrid_clock.cc:648] HybridClock initialized: now 1783476818076364 us; error 42 us; skew 500 ppm
02:13:38.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.077282 12439 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:38.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.083784 12439 webserver.cc:533] Webserver started at http://127.11.146.195:36887/ using document root <none> and password file <none>
02:13:38.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.084817 12439 fs_manager.cc:362] Metadata directory not provided
02:13:38.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.085089 12439 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:38.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.085620 12439 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:13:38.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.090301 12439 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data/instance:
02:13:38.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e85985aa708f4e2c9e33d940b20fb566"
02:13:38.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:38 on dist-test-slave-3kxw"
02:13:38.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.091545 12439 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal/instance:
02:13:38.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e85985aa708f4e2c9e33d940b20fb566"
02:13:38.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:38 on dist-test-slave-3kxw"
02:13:38.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.099503 12439 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.003s
02:13:38.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.105948 12455 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:38.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.107275 12439 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.107663 12439 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data,/tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e85985aa708f4e2c9e33d940b20fb566"
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:13:38 on dist-test-slave-3kxw"
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.108052 12439 fs_report.cc:389] FS layout report
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data/data
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:38.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:38.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:38.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:38.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:38.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:38.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:38.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:38.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.161257 12439 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:38.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.163026 12439 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:38.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.163573 12439 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:38.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.166388 12439 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:13:38.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.170746 12439 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:13:38.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.170993 12439 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:13:38.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.171314 12439 ts_tablet_manager.cc:616] Registered 0 tablets
02:13:38.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.171516 12439 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:13:38.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.335662 12439 rpc_server.cc:307] RPC server started. Bound to: 127.11.146.195:42225
02:13:38.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.335781 12569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.146.195:42225 every 8 connection(s)
02:13:38.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.338541 12439 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/data/info.pb
02:13:38.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.344977 11851 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu as pid 12439
02:13:38.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.345595 11851 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskdJk2H7/test-tmp/mini-kudu-cluster13681061402381350017/ts-2/wal/instance
02:13:38.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.383459 12572 heartbeater.cc:344] Connected to a master server at 127.11.146.254:46623
02:13:38.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.384030 12572 heartbeater.cc:461] Registering TS with master...
02:13:38.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.385251 12572 heartbeater.cc:507] Master 127.11.146.254:46623 requested a full tablet report, sending...
02:13:38.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.388334 12570 heartbeater.cc:344] Connected to a master server at 127.11.146.252:34793
02:13:38.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.388690 12570 heartbeater.cc:461] Registering TS with master...
02:13:38.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.389595 12570 heartbeater.cc:507] Master 127.11.146.252:34793 requested a full tablet report, sending...
02:13:38.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.389801 11895 ts_manager.cc:194] Registered new tserver with Master: e85985aa708f4e2c9e33d940b20fb566 (127.11.146.195:42225)
02:13:38.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.389997 12571 heartbeater.cc:344] Connected to a master server at 127.11.146.253:34775
02:13:38.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.390338 12571 heartbeater.cc:461] Registering TS with master...
02:13:38.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.391469 12571 heartbeater.cc:507] Master 127.11.146.253:34775 requested a full tablet report, sending...
02:13:38.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.393173 12053 ts_manager.cc:194] Registered new tserver with Master: e85985aa708f4e2c9e33d940b20fb566 (127.11.146.195:42225)
02:13:38.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.394052 11972 ts_manager.cc:194] Registered new tserver with Master: e85985aa708f4e2c9e33d940b20fb566 (127.11.146.195:42225)
02:13:38.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.395378 12053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.146.195:33353
02:13:38.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.414995 11851 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:13:38.428 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:13:38.428 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:13:38.429 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.146.254"
      port: 46623
    }
    bound_http_address {
      host: "127.11.146.254"
      port: 34903
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.146.253"
      port: 34775
    }
    bound_http_address {
      host: "127.11.146.253"
      port: 38963
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.146.252"
      port: 34793
    }
    bound_http_address {
      host: "127.11.146.252"
      port: 40499
    }
  }
}

02:13:38.430 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:13:38.431 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.146.193"
      port: 45065
    }
    bound_http_address {
      host: "127.11.146.193"
      port: 37997
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.146.194"
      port: 36957
    }
    bound_http_address {
      host: "127.11.146.194"
      port: 44433
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.146.195"
      port: 42225
    }
    bound_http_address {
      host: "127.11.146.195"
      port: 36887
    }
  }
}

02:13:38.431 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:13:38.433 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:13:38.436 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:13:38.437 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.438 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.146.253:34775(127.11.146.253:34775)] connecting to peer
02:13:38.439 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.146.252:34793(127.11.146.252:34793)] Successfully connected to peer
02:13:38.441 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.146.254:46623(127.11.146.254:46623)] connecting to peer
02:13:38.442 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.11.146.252
02:13:38.443 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.146.253:34775(127.11.146.253:34775)] Successfully connected to peer
02:13:38.446 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.11.146.253
02:13:38.446 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.146.254:46623(127.11.146.254:46623)] Successfully connected to peer
02:13:38.450 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.11.146.254
02:13:38.466 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x59373f3a, L:/127.0.0.1:55308 - R:/127.11.146.253:34775] using SASL/PLAIN
02:13:38.470 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xeb810215, L:/127.0.0.1:54698 - R:/127.11.146.254:46623] using SASL/PLAIN
02:13:38.474 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xf555b3c8, L:/127.0.0.1:57532 - R:/127.11.146.252:34793] using SASL/PLAIN
02:13:38.478 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:13:38.478 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=41), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [33ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: OK, deferred=null) after lookup
02:13:38.480 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.11.146.252:34793
02:13:38.481 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:13:38.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:38.481505 11851 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 12009
02:13:38.506 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.146.252:34793(127.11.146.252:34793)] handling channelInactive
02:13:38.507 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state READY due to: connection closed
02:13:38.510 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:13:38.511 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.514 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.514 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.514 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location master-127.11.146.252:34793(127.11.146.252:34793) for tablet Kudu Master: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.518 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.520 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.520 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.521 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.524 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.538 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.540 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.541 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.541 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.543 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.557 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.559 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.559 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.560 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.562 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.578 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.580 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.580 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.580 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.582 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.618 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.619 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.619 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.620 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.623 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.657 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.659 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.659 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.660 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.662 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.737 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.739 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.739 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.739 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.741 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:38.997 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:38.999 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.999 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:38.999 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.002 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:39.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.278512 12429 heartbeater.cc:646] Failed to heartbeat to 127.11.146.252:34793 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:39.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.307230 12287 heartbeater.cc:646] Failed to heartbeat to 127.11.146.252:34793 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:39.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.398782 12570 heartbeater.cc:499] Master 127.11.146.252:34793 was elected leader, sending a full tablet report...
02:13:39.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.402340 12570 heartbeater.cc:646] Failed to heartbeat to 127.11.146.252:34793 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:39.477 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:39.479 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.479 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.479 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.481 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:39.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.483641 12593 raft_consensus.cc:493] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3faba6bf119a438183d1fd7f3c231a56)
02:13:39.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.484082 12593 raft_consensus.cc:515] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:39.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.486150 12593 leader_election.cc:290] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092efe4d06714d8085c4b32ec2152d8c (127.11.146.254:46623), 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793)
02:13:39.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.487237 11906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "58968e6e34c44271a2000dbbdb1ffe77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092efe4d06714d8085c4b32ec2152d8c" is_pre_election: true
02:13:39.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.488701 11959 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111) [suppressed 6 similar messages]
02:13:39.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.491988 11959 leader_election.cc:336] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793): Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:39.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.492372 11959 leader_election.cc:304] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58968e6e34c44271a2000dbbdb1ffe77; no voters: 092efe4d06714d8085c4b32ec2152d8c, 3faba6bf119a438183d1fd7f3c231a56
02:13:39.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.493000 12593 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:13:39.798 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:39.799 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.799 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.799 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:39.802 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623; will retry
02:13:39.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.927415 12596 raft_consensus.cc:493] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3faba6bf119a438183d1fd7f3c231a56)
02:13:39.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.927891 12596 raft_consensus.cc:515] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:39.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.929636 12596 leader_election.cc:290] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 58968e6e34c44271a2000dbbdb1ffe77 (127.11.146.253:34775), 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793)
02:13:39.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.930860 11982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "092efe4d06714d8085c4b32ec2152d8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58968e6e34c44271a2000dbbdb1ffe77" is_pre_election: true
02:13:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.931650 11982 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092efe4d06714d8085c4b32ec2152d8c in term 1.
02:13:39.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.932492 11883 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111) [suppressed 13 similar messages]
02:13:39.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.932999 11880 leader_election.cc:304] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092efe4d06714d8085c4b32ec2152d8c, 58968e6e34c44271a2000dbbdb1ffe77; no voters: 
02:13:39.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.934123 12596 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Leader pre-election won for term 2
02:13:39.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.934625 12596 raft_consensus.cc:493] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3faba6bf119a438183d1fd7f3c231a56)
02:13:39.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.934960 12596 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 1 FOLLOWER]: Advancing to term 2
02:13:39.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.936652 11883 leader_election.cc:336] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793): Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:39.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.942150 12596 raft_consensus.cc:515] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:39.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.943812 12596 leader_election.cc:290] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 2 election: Requested vote from peers 58968e6e34c44271a2000dbbdb1ffe77 (127.11.146.253:34775), 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793)
02:13:39.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.944653 11982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "092efe4d06714d8085c4b32ec2152d8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58968e6e34c44271a2000dbbdb1ffe77"
02:13:39.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.945115 11982 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 1 FOLLOWER]: Advancing to term 2
02:13:39.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:39.947234 11883 leader_election.cc:336] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793): Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111)
02:13:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.951037 11982 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092efe4d06714d8085c4b32ec2152d8c in term 2.
02:13:39.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.952190 11880 leader_election.cc:304] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092efe4d06714d8085c4b32ec2152d8c, 58968e6e34c44271a2000dbbdb1ffe77; no voters: 3faba6bf119a438183d1fd7f3c231a56
02:13:39.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.952850 12596 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 2 FOLLOWER]: Leader election won for term 2
02:13:39.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.953755 12596 raft_consensus.cc:697] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [term 2 LEADER]: Becoming Leader. State: Replica: 092efe4d06714d8085c4b32ec2152d8c, State: Running, Role: LEADER
02:13:39.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.954615 12596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } }
02:13:39.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.958793 12599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 092efe4d06714d8085c4b32ec2152d8c. Latest consensus state: current_term: 2 leader_uuid: "092efe4d06714d8085c4b32ec2152d8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:39.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.959764 12599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: This master's current role is: LEADER
02:13:39.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.961278 12601 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:13:39.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.966682 12601 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:13:39.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.969187 12601 catalog_manager.cc:1295] Loaded cluster ID: bd6b208a86974ebbae9b5905cdd304f2
02:13:39.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.969396 12601 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:13:39.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.972505 12601 catalog_manager.cc:1540] Loading token signing keys...
02:13:39.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.975047 12601 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c: Loaded TSK: 0
02:13:39.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:39.976485 12601 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:13:40.098 [DEBUG - pool-14-thread-1] (Connection.java:748) [peer master-127.11.146.252:34793(127.11.146.252:34793)] connecting to peer
02:13:40.099 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:40.099 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.11.146.252:34793(127.11.146.252:34793)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:40.099 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.11.146.252:34793: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793
02:13:40.104 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:13:40.105 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=50000, elapsed=1593), Traces: [0ms] sending RPC to server master-127.11.146.252:34793, [3ms] received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [6ms] refreshing cache from master, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [8ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [9ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [12ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [13ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [13ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [27ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [30ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [32ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [32ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [32ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [49ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [51ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [51ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [51ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [66ms] refreshing cache from master, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [69ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [72ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [107ms] refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [109ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [112ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [112ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [112ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [145ms] refreshing cache from master, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [149ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [151ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [151ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [151ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [226ms] refreshing cache from master, [226ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [228ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [230ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [230ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [231ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [486ms] refreshing cache from master, [486ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [487ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [487ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [488ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [490ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [491ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [491ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [966ms] refreshing cache from master, [966ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [967ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [967ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [968ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [970ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [970ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [971ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [1286ms] refreshing cache from master, [1286ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [1287ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [1288ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [1288ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [1291ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [1291ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, [1291ms] delaying RPC due to: Service unavailable: Master config (127.11.146.252:34793,127.11.146.253:34775,127.11.146.254:46623) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [1586ms] refreshing cache from master, [1586ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.252:34793, [1587ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.253:34775, [1588ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.146.254:46623, [1588ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.252:34793: Network error: Failed to connect to peer master-127.11.146.252:34793(127.11.146.252:34793): Connection refused: /127.11.146.252:34793, [1590ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.253:34775: OK, [1592ms] Sub RPC ConnectToMaster: received response from server master-127.11.146.254:46623: OK, deferred=Deferred@1153698951(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$198/0x00007f591028db68@31eed846 -> org.apache.kudu.client.AsyncKuduClient$$Lambda$199/0x00007f591028dd90@d506395 -> wakeup thread Time-limited test -> (continuation of Deferred@700747870 after retry RPC after error@1291846101) -> (continuation of Deferred@183225563 after retry RPC after error@78207704) -> (continuation of Deferred@165833843 after retry RPC after error@1151457843) -> (continuation of Deferred@284711784 after retry RPC after error@1581890613) -> (continuation of Deferred@1146278523 after retry RPC after error@250144896) -> (continuation of Deferred@1545191726 after retry RPC after error@1327658636) -> (continuation of Deferred@489792537 after retry RPC after error@1414849495) -> (continuation of Deferred@1188452546 after retry RPC after error@446484610) -> (continuation of Deferred@169721508 after retry RPC after error@2032447083) -> (continuation of Deferred@230750661 after retry RPC after error@1906585663), errback=passthrough -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@700747870 after retry RPC after error@1291846101) -> (continuation of Deferred@183225563 after retry RPC after error@78207704) -> (continuation of Deferred@165833843 after retry RPC after error@1151457843) -> (continuation of Deferred@284711784 after retry RPC after error@1581890613) -> (continuation of Deferred@1146278523 after retry RPC after error@250144896) -> (continuation of Deferred@1545191726 after retry RPC after error@1327658636) -> (continuation of Deferred@489792537 after retry RPC after error@1414849495) -> (continuation of Deferred@1188452546 after retry RPC after error@446484610) -> (continuation of Deferred@169721508 after retry RPC after error@2032447083) -> (continuation of Deferred@230750661 after retry RPC after error@1906585663))) after lookup
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.107914 11895 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54698:
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=CREATE_TABLE"
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:40.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:40.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:13:40.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:13:40.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.131798 11895 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=CREATE_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:13:40.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.143908 11982 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [term 2 FOLLOWER]: Refusing update from remote peer 092efe4d06714d8085c4b32ec2152d8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
02:13:40.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.145362 12596 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
02:13:40.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.146301 11883 consensus_peers.cc:597] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c -> Peer 3faba6bf119a438183d1fd7f3c231a56 (127.11.146.252:34793): Couldn't send request to peer 3faba6bf119a438183d1fd7f3c231a56. Status: Network error: Client connection negotiation failed: client connection to 127.11.146.252:34793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:13:40.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.152619 12603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 092efe4d06714d8085c4b32ec2152d8c. Latest consensus state: current_term: 2 leader_uuid: "092efe4d06714d8085c4b32ec2152d8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:40.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.153316 12603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: This master's current role is: FOLLOWER
02:13:40.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.156687 12596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "092efe4d06714d8085c4b32ec2152d8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:40.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.157459 12596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 092efe4d06714d8085c4b32ec2152d8c [sys.catalog]: This master's current role is: LEADER
02:13:40.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.158905 12603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "092efe4d06714d8085c4b32ec2152d8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092efe4d06714d8085c4b32ec2152d8c" member_type: VOTER last_known_addr { host: "127.11.146.254" port: 46623 } } peers { permanent_uuid: "58968e6e34c44271a2000dbbdb1ffe77" member_type: VOTER last_known_addr { host: "127.11.146.253" port: 34775 } } peers { permanent_uuid: "3faba6bf119a438183d1fd7f3c231a56" member_type: VOTER last_known_addr { host: "127.11.146.252" port: 34793 } } }
02:13:40.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.160629 12603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58968e6e34c44271a2000dbbdb1ffe77 [sys.catalog]: This master's current role is: FOLLOWER
02:13:40.166 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 9dd1b6b6452140a69014559d16dc8c47
02:13:40.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.227061 12222 tablet_service.cc:1511] Processing CreateTablet for tablet f6a65ee00fb04df39ac00db56add5b38 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=9dd1b6b6452140a69014559d16dc8c47]), partition=RANGE (key) PARTITION UNBOUNDED
02:13:40.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.229543 12222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a65ee00fb04df39ac00db56add5b38. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:40.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.230870 12362 tablet_service.cc:1511] Processing CreateTablet for tablet f6a65ee00fb04df39ac00db56add5b38 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=9dd1b6b6452140a69014559d16dc8c47]), partition=RANGE (key) PARTITION UNBOUNDED
02:13:40.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.233170 12362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a65ee00fb04df39ac00db56add5b38. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:40.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.235277 12505 tablet_service.cc:1511] Processing CreateTablet for tablet f6a65ee00fb04df39ac00db56add5b38 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=9dd1b6b6452140a69014559d16dc8c47]), partition=RANGE (key) PARTITION UNBOUNDED
02:13:40.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.237023 12505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a65ee00fb04df39ac00db56add5b38. 1 dirs total, 0 dirs full, 0 dirs failed
02:13:40.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.265918 12616 tablet_bootstrap.cc:492] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: Bootstrap starting.
02:13:40.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.266458 12615 tablet_bootstrap.cc:492] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: Bootstrap starting.
02:13:40.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.276932 12616 tablet_bootstrap.cc:654] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: Neither blocks nor log segments found. Creating new log.
02:13:40.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.278785 12615 tablet_bootstrap.cc:654] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: Neither blocks nor log segments found. Creating new log.
02:13:40.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.281545 12615 log.cc:826] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: Log is configured to *not* fsync() on all Append() calls
02:13:40.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.283162 12616 log.cc:826] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: Log is configured to *not* fsync() on all Append() calls
02:13:40.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.276476 12617 tablet_bootstrap.cc:492] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: Bootstrap starting.
02:13:40.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.295084 12616 tablet_bootstrap.cc:492] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: No bootstrap required, opened a new log
02:13:40.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.295934 12616 ts_tablet_manager.cc:1403] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
02:13:40.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.303360 12617 tablet_bootstrap.cc:654] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: Neither blocks nor log segments found. Creating new log.
02:13:40.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.306969 12617 log.cc:826] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: Log is configured to *not* fsync() on all Append() calls
02:13:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.310870 12615 tablet_bootstrap.cc:492] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: No bootstrap required, opened a new log
02:13:40.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.311904 12615 ts_tablet_manager.cc:1403] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: Time spent bootstrapping tablet: real 0.046s	user 0.027s	sys 0.014s
02:13:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.328908 12616 raft_consensus.cc:359] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.329975 12617 tablet_bootstrap.cc:492] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: No bootstrap required, opened a new log
02:13:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.330364 12616 raft_consensus.cc:385] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:40.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.330544 12617 ts_tablet_manager.cc:1403] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: Time spent bootstrapping tablet: real 0.055s	user 0.030s	sys 0.005s
02:13:40.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.330924 12616 raft_consensus.cc:740] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e85985aa708f4e2c9e33d940b20fb566, State: Initialized, Role: FOLLOWER
02:13:40.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.332362 12616 consensus_queue.cc:260] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.342986 12616 ts_tablet_manager.cc:1434] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: Time spent starting tablet: real 0.047s	user 0.034s	sys 0.008s
02:13:40.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.345356 12615 raft_consensus.cc:359] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.346355 12615 raft_consensus.cc:385] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:40.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.346678 12615 raft_consensus.cc:740] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ae2c053301649d78a2b4b55a8923404, State: Initialized, Role: FOLLOWER
02:13:40.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.347720 12615 consensus_queue.cc:260] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.353760 12574 tablet.cc:2406] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:40.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.362751 12617 raft_consensus.cc:359] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.364089 12617 raft_consensus.cc:385] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:13:40.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.364493 12617 raft_consensus.cc:740] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04b4b62bcf6b450f898357ac42cb7c36, State: Initialized, Role: FOLLOWER
02:13:40.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.366614 12617 consensus_queue.cc:260] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.370646 12572 heartbeater.cc:499] Master 127.11.146.254:46623 was elected leader, sending a full tablet report...
02:13:40.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.376286 12431 heartbeater.cc:499] Master 127.11.146.254:46623 was elected leader, sending a full tablet report...
02:13:40.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.379442 12617 ts_tablet_manager.cc:1434] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: Time spent starting tablet: real 0.049s	user 0.032s	sys 0.013s
02:13:40.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.394388 12615 ts_tablet_manager.cc:1434] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: Time spent starting tablet: real 0.082s	user 0.054s	sys 0.024s
02:13:40.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.395327 12289 heartbeater.cc:499] Master 127.11.146.254:46623 was elected leader, sending a full tablet report...
02:13:40.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.437685 12623 raft_consensus.cc:493] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:13:40.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.438400 12623 raft_consensus.cc:515] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.443295 12623 leader_election.cc:290] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04b4b62bcf6b450f898357ac42cb7c36 (127.11.146.194:36957), 1ae2c053301649d78a2b4b55a8923404 (127.11.146.193:45065)
02:13:40.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.459941 12382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a65ee00fb04df39ac00db56add5b38" candidate_uuid: "e85985aa708f4e2c9e33d940b20fb566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b4b62bcf6b450f898357ac42cb7c36" is_pre_election: true
02:13:40.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.460959 12382 raft_consensus.cc:2468] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e85985aa708f4e2c9e33d940b20fb566 in term 0.
02:13:40.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.463162 12459 leader_election.cc:304] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04b4b62bcf6b450f898357ac42cb7c36, e85985aa708f4e2c9e33d940b20fb566; no voters: 
02:13:40.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.464551 12623 raft_consensus.cc:2804] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:13:40.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.465116 12623 raft_consensus.cc:493] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:13:40.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.466549 12623 raft_consensus.cc:3060] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 0 FOLLOWER]: Advancing to term 1
02:13:40.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.473917 12242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a65ee00fb04df39ac00db56add5b38" candidate_uuid: "e85985aa708f4e2c9e33d940b20fb566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ae2c053301649d78a2b4b55a8923404" is_pre_election: true
02:13:40.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.475059 12242 raft_consensus.cc:2468] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e85985aa708f4e2c9e33d940b20fb566 in term 0.
02:13:40.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.477237 12623 raft_consensus.cc:515] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.480686 12382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a65ee00fb04df39ac00db56add5b38" candidate_uuid: "e85985aa708f4e2c9e33d940b20fb566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04b4b62bcf6b450f898357ac42cb7c36"
02:13:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.481274 12382 raft_consensus.cc:3060] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [term 0 FOLLOWER]: Advancing to term 1
02:13:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.481429 12242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a65ee00fb04df39ac00db56add5b38" candidate_uuid: "e85985aa708f4e2c9e33d940b20fb566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ae2c053301649d78a2b4b55a8923404"
02:13:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.481984 12242 raft_consensus.cc:3060] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [term 0 FOLLOWER]: Advancing to term 1
02:13:40.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.482779 12436 tablet.cc:2406] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:40.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.485958 12623 leader_election.cc:290] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [CANDIDATE]: Term 1 election: Requested vote from peers 04b4b62bcf6b450f898357ac42cb7c36 (127.11.146.194:36957), 1ae2c053301649d78a2b4b55a8923404 (127.11.146.193:45065)
02:13:40.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.488826 12382 raft_consensus.cc:2468] T f6a65ee00fb04df39ac00db56add5b38 P 04b4b62bcf6b450f898357ac42cb7c36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e85985aa708f4e2c9e33d940b20fb566 in term 1.
02:13:40.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.488924 12242 raft_consensus.cc:2468] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e85985aa708f4e2c9e33d940b20fb566 in term 1.
02:13:40.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.489959 12459 leader_election.cc:304] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04b4b62bcf6b450f898357ac42cb7c36, e85985aa708f4e2c9e33d940b20fb566; no voters: 
02:13:40.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.490610 12623 raft_consensus.cc:2804] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 1 FOLLOWER]: Leader election won for term 1
02:13:40.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.492395 12623 raft_consensus.cc:697] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [term 1 LEADER]: Becoming Leader. State: Replica: e85985aa708f4e2c9e33d940b20fb566, State: Running, Role: LEADER
02:13:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.493263 12623 consensus_queue.cc:237] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } }
02:13:40.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.502888 12296 tablet.cc:2406] T f6a65ee00fb04df39ac00db56add5b38 P 1ae2c053301649d78a2b4b55a8923404: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:13:40.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.506217 11895 catalog_manager.cc:5697] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 reported cstate change: term changed from 0 to 1, leader changed from <none> to e85985aa708f4e2c9e33d940b20fb566 (127.11.146.195). New cstate: current_term: 1 leader_uuid: "e85985aa708f4e2c9e33d940b20fb566" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e85985aa708f4e2c9e33d940b20fb566" member_type: VOTER last_known_addr { host: "127.11.146.195" port: 42225 } health_report { overall_health: HEALTHY } } }
02:13:40.563 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 9dd1b6b6452140a69014559d16dc8c47
02:13:40.567 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f6a65ee00fb04df39ac00db56add5b38 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
02:13:40.567 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f6a65ee00fb04df39ac00db56add5b38@[04b4b62bcf6b450f898357ac42cb7c36(127.11.146.194:36957),1ae2c053301649d78a2b4b55a8923404(127.11.146.193:45065),e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)[L]]}]
02:13:40.568 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, deferred=null)) after lookup
02:13:40.568 [DEBUG - kudu-nio-2] (Connection.java:748) [peer e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)] connecting to peer
02:13:40.569 [DEBUG - kudu-nio-7] (Connection.java:757) [peer e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)] Successfully connected to peer
02:13:40.587 [DEBUG - kudu-nio-7] (Negotiator.java:918) Authenticated connection [id: 0xa70520f4, L:/127.0.0.1:51842 - R:/127.11.146.195:42225] using TOKEN/null
02:13:40.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.591488 12485 tablet_service.cc:3018] Rejecting scan request for tablet f6a65ee00fb04df39ac00db56add5b38: Uninitialized: clean time has not yet been initialized
02:13:40.593 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225) for tablet f6a65ee00fb04df39ac00db56add5b38: clean time has not yet been initialized
02:13:40.601 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f6a65ee00fb04df39ac00db56add5b38 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
02:13:40.601 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f6a65ee00fb04df39ac00db56add5b38@[04b4b62bcf6b450f898357ac42cb7c36(127.11.146.194:36957),1ae2c053301649d78a2b4b55a8923404(127.11.146.193:45065),e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)[L]]}]
02:13:40.601 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=3, KuduRpc(method=Scan, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=3, TimeoutTracker(timeout=30000, elapsed=38), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [5ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [37ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, deferred=Deferred@297870309(state=PENDING, result=null, callback=(continuation of Deferred@1886226689 after retry RPC@1860438094), errback=(continuation of Deferred@1886226689 after retry RPC@1860438094)))) after lookup
02:13:40.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.604733 12485 tablet_service.cc:3018] Rejecting scan request for tablet f6a65ee00fb04df39ac00db56add5b38: Uninitialized: clean time has not yet been initialized
02:13:40.606 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225) for tablet f6a65ee00fb04df39ac00db56add5b38: clean time has not yet been initialized
02:13:40.642 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f6a65ee00fb04df39ac00db56add5b38 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
02:13:40.642 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f6a65ee00fb04df39ac00db56add5b38@[04b4b62bcf6b450f898357ac42cb7c36(127.11.146.194:36957),1ae2c053301649d78a2b4b55a8923404(127.11.146.193:45065),e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)[L]]}]
02:13:40.642 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=5, KuduRpc(method=Scan, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=5, TimeoutTracker(timeout=30000, elapsed=78), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [5ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [37ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [38ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [43ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [43ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [78ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, deferred=Deferred@297870309(state=PENDING, result=null, callback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717), errback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717)))) after lookup
02:13:40.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.645582 12485 tablet_service.cc:3018] Rejecting scan request for tablet f6a65ee00fb04df39ac00db56add5b38: Uninitialized: clean time has not yet been initialized
02:13:40.647 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225) for tablet f6a65ee00fb04df39ac00db56add5b38: clean time has not yet been initialized
02:13:40.681 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f6a65ee00fb04df39ac00db56add5b38 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
02:13:40.681 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f6a65ee00fb04df39ac00db56add5b38@[04b4b62bcf6b450f898357ac42cb7c36(127.11.146.194:36957),1ae2c053301649d78a2b4b55a8923404(127.11.146.193:45065),e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)[L]]}]
02:13:40.682 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=7, KuduRpc(method=Scan, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=7, TimeoutTracker(timeout=30000, elapsed=118), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [5ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [37ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [38ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [43ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [43ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [78ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [79ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [84ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [84ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [118ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, deferred=Deferred@297870309(state=PENDING, result=null, callback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717) -> (continuation of Deferred@1651299038 after retry RPC@1839994383), errback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717) -> (continuation of Deferred@1651299038 after retry RPC@1839994383)))) after lookup
02:13:40.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.684962 12485 tablet_service.cc:3018] Rejecting scan request for tablet f6a65ee00fb04df39ac00db56add5b38: Uninitialized: clean time has not yet been initialized
02:13:40.686 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225) for tablet f6a65ee00fb04df39ac00db56add5b38: clean time has not yet been initialized
02:13:40.840 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f6a65ee00fb04df39ac00db56add5b38 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
02:13:40.841 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f6a65ee00fb04df39ac00db56add5b38@[04b4b62bcf6b450f898357ac42cb7c36(127.11.146.194:36957),1ae2c053301649d78a2b4b55a8923404(127.11.146.193:45065),e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)[L]]}]
02:13:40.841 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=9, KuduRpc(method=Scan, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=9, TimeoutTracker(timeout=30000, elapsed=277), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [5ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [37ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [38ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [43ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [43ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [78ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [79ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [84ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [84ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [118ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [119ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [123ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [123ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [273ms] refreshing cache from master, [274ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [277ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, deferred=Deferred@297870309(state=PENDING, result=null, callback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717) -> (continuation of Deferred@1651299038 after retry RPC@1839994383) -> (continuation of Deferred@1706094268 after retry RPC@1632516854), errback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717) -> (continuation of Deferred@1651299038 after retry RPC@1839994383) -> (continuation of Deferred@1706094268 after retry RPC@1632516854)))) after lookup
02:13:40.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:40.844419 12485 tablet_service.cc:3018] Rejecting scan request for tablet f6a65ee00fb04df39ac00db56add5b38: Uninitialized: clean time has not yet been initialized
02:13:40.846 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225) for tablet f6a65ee00fb04df39ac00db56add5b38: clean time has not yet been initialized
02:13:40.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.930317 12623 consensus_queue.cc:1048] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04b4b62bcf6b450f898357ac42cb7c36" member_type: VOTER last_known_addr { host: "127.11.146.194" port: 36957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:13:40.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:40.953419 12623 consensus_queue.cc:1048] T f6a65ee00fb04df39ac00db56add5b38 P e85985aa708f4e2c9e33d940b20fb566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ae2c053301649d78a2b4b55a8923404" member_type: VOTER last_known_addr { host: "127.11.146.193" port: 45065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:13:41.221 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f6a65ee00fb04df39ac00db56add5b38 for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
02:13:41.221 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f6a65ee00fb04df39ac00db56add5b38@[04b4b62bcf6b450f898357ac42cb7c36(127.11.146.194:36957),1ae2c053301649d78a2b4b55a8923404(127.11.146.193:45065),e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)[L]]}]
02:13:41.222 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=11, KuduRpc(method=Scan, tablet=f6a65ee00fb04df39ac00db56add5b38, attempt=11, TimeoutTracker(timeout=30000, elapsed=658), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [4ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [5ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [30ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [30ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [34ms] refreshing cache from master, [34ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [37ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [38ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [43ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [43ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [78ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [79ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [84ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [84ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [118ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [119ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [123ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [123ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [273ms] refreshing cache from master, [274ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [277ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, [278ms] sending RPC to server e85985aa708f4e2c9e33d940b20fb566, [283ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [283ms] received response from server e85985aa708f4e2c9e33d940b20fb566: Uninitialized: clean time has not yet been initialized (error 0), [654ms] refreshing cache from master, [654ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.146.254:46623, [658ms] Sub RPC GetTableLocations: received response from server master-127.11.146.254:46623: OK, deferred=Deferred@297870309(state=PENDING, result=null, callback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717) -> (continuation of Deferred@1651299038 after retry RPC@1839994383) -> (continuation of Deferred@1706094268 after retry RPC@1632516854) -> (continuation of Deferred@1428150618 after retry RPC@926419019), errback=(continuation of Deferred@1886226689 after retry RPC@1860438094) -> (continuation of Deferred@288612251 after retry RPC@227174717) -> (continuation of Deferred@1651299038 after retry RPC@1839994383) -> (continuation of Deferred@1706094268 after retry RPC@1632516854) -> (continuation of Deferred@1428150618 after retry RPC@926419019)))) after lookup
02:13:41.230 [DEBUG - kudu-nio-7] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=CREATE_TABLE, tablet=f6a65ee00fb04df39ac00db56add5b38, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:13:41.231 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:13:41.234 [DEBUG - main] (Connection.java:575) [peer master-127.11.146.254:46623(127.11.146.254:46623)] disconnecting while in state READY
02:13:41.234 [DEBUG - main] (Connection.java:575) [peer master-127.11.146.253:34775(127.11.146.253:34775)] disconnecting while in state READY
02:13:41.235 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.146.254:46623(127.11.146.254:46623)] handling channelInactive
02:13:41.235 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.146.254:46623(127.11.146.254:46623)] cleaning up while in state READY due to: connection closed
02:13:41.235 [DEBUG - main] (Connection.java:575) [peer e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)] disconnecting while in state READY
02:13:41.235 [DEBUG - main] (Connection.java:575) [peer master-127.11.146.252:34793(127.11.146.252:34793)] disconnecting while in state TERMINATED
02:13:41.236 [DEBUG - kudu-nio-7] (Connection.java:239) [peer e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)] handling channelInactive
02:13:41.236 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.146.253:34775(127.11.146.253:34775)] handling channelInactive
02:13:41.236 [DEBUG - kudu-nio-7] (Connection.java:709) [peer e85985aa708f4e2c9e33d940b20fb566(127.11.146.195:42225)] cleaning up while in state READY due to: connection closed
02:13:41.236 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.146.253:34775(127.11.146.253:34775)] cleaning up while in state READY due to: connection closed
02:13:41.236 [DEBUG - kudu-nio-6] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:13:41.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:41.239425 11851 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 12140
02:13:41.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:41.268702 11851 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 12298
02:13:41.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:41.300513 11851 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 12439
02:13:41.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:41.329502 11851 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11863
02:13:41.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:41.366366 11851 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskdJk2H7/build/tsan/bin/kudu with pid 11934
02:13:42.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:42Z chronyd exiting

Time: 89.034

OK (4 tests)

