JUnit version 4.13.2
.02:12:21.520 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783476741510
02:12:21.583 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:12:21.643 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:12:21.650 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task2lK8M4/test-tmp
02:12:21.655 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:12:21.657 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task2lK8M4/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:12:21.829 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:12:22.022 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:22.024 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:12:22.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.027873 30176 mini_oidc.cc:150] Starting JWKS server
02:12:22.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.031635 30176 webserver.cc:533] Webserver started at http://127.0.0.1:36397/ using document root <none> and password file <none>
02:12:22.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.032332 30176 mini_oidc.cc:186] Starting OIDC Discovery server
02:12:22.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.034142 30176 webserver.cc:533] Webserver started at http://127.0.0.1:36047/ using document root <none> and password file <none>
02:12:22.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:22Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:12:22.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:22Z Disabled control of system clock
02:12:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.095157 30176 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:22.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:22.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:22.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:22.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/logs
02:12:22.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data/info.pb
02:12:22.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:22.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:22.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:22.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:22.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:22.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:22.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:22.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:22.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:22.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:22.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:22.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:22.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.62:38375
02:12:22.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.62
02:12:22.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:22.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:22.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:22.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:22.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36397/jwks.json with env {}
02:12:22.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.395762 30188 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.396341 30188 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.397070 30188 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:22.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.430241 30188 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.430565 30188 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.430800 30188 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.430995 30188 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.431186 30188 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.431443 30188 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36397/jwks.json
02:12:22.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.469079 30188 master_runner.cc:387] Master server non-default flags:
02:12:22.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:22.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:22.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:22.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:22.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data
02:12:22.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal
02:12:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.62:38375
02:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36397/jwks.json
02:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data/info.pb
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.62
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/logs
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:22.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:22.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:22.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:22.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:22.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:22.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:22.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.470430 30188 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:22.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:22.472601 30188 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:22.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.486528 30194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.491757 30197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:23.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:22.487377 30195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:23.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.719633 30196 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1228 milliseconds
02:12:23.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.719753 30188 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:23.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.721092 30188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:23.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.723572 30188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:23.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.724937 30188 hybrid_clock.cc:648] HybridClock initialized: now 1783476743724904 us; error 37 us; skew 500 ppm
02:12:23.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.725893 30188 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:23.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.731899 30188 webserver.cc:533] Webserver started at http://127.29.120.62:34007/ using document root <none> and password file <none>
02:12:23.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.733039 30188 fs_manager.cc:362] Metadata directory not provided
02:12:23.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.733310 30188 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:23.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.733901 30188 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:23.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.738320 30188 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data/instance:
02:12:23.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "54ac59214e7646a29c985e2568c0ff8b"
02:12:23.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:23 on dist-test-slave-3cc9"
02:12:23.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.739750 30188 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal/instance:
02:12:23.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "54ac59214e7646a29c985e2568c0ff8b"
02:12:23.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:23 on dist-test-slave-3cc9"
02:12:23.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.747418 30188 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
02:12:23.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.753412 30204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:23.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.754664 30188 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
02:12:23.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.755106 30188 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal
02:12:23.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "54ac59214e7646a29c985e2568c0ff8b"
02:12:23.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:23 on dist-test-slave-3cc9"
02:12:23.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.755549 30188 fs_report.cc:389] FS layout report
02:12:23.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:23.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal
02:12:23.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal
02:12:23.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data/data
02:12:23.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:23.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:23.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:23.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:23.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:23.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:23.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:23.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:23.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:23.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:23.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:23.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.809083 30188 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:23.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.811342 30188 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:23.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.811900 30188 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:23.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.883922 30188 rpc_server.cc:307] RPC server started. Bound to: 127.29.120.62:38375
02:12:23.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.884012 30255 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.120.62:38375 every 8 connection(s)
02:12:23.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.886936 30188 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/data/info.pb
02:12:23.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.889736 30176 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 30188
02:12:23.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.890338 30176 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-0/wal/instance
02:12:23.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.894086 30256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:23.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.894099 30176 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:23.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal
02:12:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data
02:12:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:23.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/logs
02:12:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data/info.pb
02:12:23.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:23.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:23.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:23.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:23.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:23.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:23.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:23.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:23.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:23.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:23.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:23.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:23.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.61:40613
02:12:23.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.61
02:12:23.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:23.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:23.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:23.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:23.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:23.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:23.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:23.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:23.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36397/jwks.json with env {}
02:12:23.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.907548 30256 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } has no permanent_uuid. Determining permanent_uuid...
02:12:23.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.935240 30256 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
02:12:23.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.937716 30207 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:23.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.941680 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:23.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:23.991132 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 1
02:12:23.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:23.995535 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:24.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.063925 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 2
02:12:24.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.068361 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:24.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.159794 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 3
02:12:24.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.166090 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:24.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.207479 30258 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:24.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.208027 30258 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:24.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.208470 30258 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:24.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.240909 30258 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:24.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.241907 30258 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:24.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.242280 30258 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:24.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.242643 30258 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.243034 30258 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.243356 30258 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36397/jwks.json
02:12:24.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.280191 30258 master_runner.cc:387] Master server non-default flags:
02:12:24.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:24.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:24.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:24.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.61:40613
02:12:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36397/jwks.json
02:12:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data/info.pb
02:12:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.61
02:12:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:24.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:24.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:24.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:24.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:24.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/logs
02:12:24.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:24.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:24.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:24.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:24.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:24.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:24.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:24.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:24.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:24.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:24.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.282032 30258 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:24.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.284368 30258 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.298054 30267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.309545 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 4
02:12:24.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.318248 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:24.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:24.617808 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 5
02:12:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.629846 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:25.177374 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 6
02:12:25.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:25.209307 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:26.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.269897 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 7
02:12:26.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:25.701176 30266 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 30258
02:12:26.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.284935 30258 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.987s	user 0.688s	sys 1.289s
02:12:26.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.285431 30258 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.988s	user 0.688s	sys 1.289s
02:12:26.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.288477 30270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:26.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.289532 30269 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1989 milliseconds
02:12:26.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.291999 30258 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:26.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:24.298527 30268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:26.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.299453 30258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:26.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.302556 30256 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.61:40613: Network error: Client connection negotiation failed: client connection to 127.29.120.61:40613: connect: Connection refused (error 111)
02:12:26.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.303938 30258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.305810 30258 hybrid_clock.cc:648] HybridClock initialized: now 1783476746305743 us; error 93 us; skew 500 ppm
02:12:26.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.306672 30258 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:26.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.320195 30258 webserver.cc:533] Webserver started at http://127.29.120.61:44727/ using document root <none> and password file <none>
02:12:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.321269 30258 fs_manager.cc:362] Metadata directory not provided
02:12:26.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.321471 30258 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:26.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.322041 30258 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:26.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.326916 30258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data/instance:
02:12:26.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "181c75c7e0ca49d498e64ed6e9e7843c"
02:12:26.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:26 on dist-test-slave-3cc9"
02:12:26.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.328123 30258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal/instance:
02:12:26.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "181c75c7e0ca49d498e64ed6e9e7843c"
02:12:26.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:26 on dist-test-slave-3cc9"
02:12:26.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.338572 30258 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.006s	sys 0.006s
02:12:26.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.349068 30281 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:26.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.350512 30258 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.001s	sys 0.006s
02:12:26.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.350850 30258 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal
02:12:26.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "181c75c7e0ca49d498e64ed6e9e7843c"
02:12:26.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:26 on dist-test-slave-3cc9"
02:12:26.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.351274 30258 fs_report.cc:389] FS layout report
02:12:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal
02:12:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal
02:12:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data/data
02:12:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:26.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:26.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:26.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:26.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.420121 30258 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:26.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.423247 30258 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:26.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.424049 30258 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:26.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.527662 30258 rpc_server.cc:307] RPC server started. Bound to: 127.29.120.61:40613
02:12:26.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.527741 30332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.120.61:40613 every 8 connection(s)
02:12:26.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.530287 30258 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/data/info.pb
02:12:26.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.532516 30176 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 30258
02:12:26.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.533082 30176 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-1/wal/instance
02:12:26.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.535189 30176 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:26.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:26.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:26.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/logs
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data/info.pb
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:26.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:26.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.60:33989
02:12:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.60
02:12:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:26.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36397/jwks.json with env {}
02:12:26.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.536674 30333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:26.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.549388 30333 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } has no permanent_uuid. Determining permanent_uuid...
02:12:26.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.570096 30333 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
02:12:26.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.584380 30333 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } has no permanent_uuid. Determining permanent_uuid...
02:12:26.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.586930 30285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:26.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.591339 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:26.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.640893 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 1
02:12:26.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.645913 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:26.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.714380 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 2
02:12:26.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.718816 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:26.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.810266 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 3
02:12:26.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.814960 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:26.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.860577 30335 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:26.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.861285 30335 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:26.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.861841 30335 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:26.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.894991 30335 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:26.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.895280 30335 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:26.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.895572 30335 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:26.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.895774 30335 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:26.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.895953 30335 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:26.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.896173 30335 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36397/jwks.json
02:12:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.932699 30335 master_runner.cc:387] Master server non-default flags:
02:12:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.60:33989
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:26.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36397/jwks.json
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data/info.pb
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.60
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/logs
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:26.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.934053 30335 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:26.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.936151 30335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:26.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.947520 30345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:26.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:26.958410 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 4
02:12:26.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.964895 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:27.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.264436 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 5
02:12:27.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.271742 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:27.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:27.819370 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 6
02:12:27.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:27.834764 30333 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.29.120.60:33989: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:28.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.949357 30346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:28.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:26.953379 30348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:28.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.180004 30347 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1226 milliseconds
02:12:28.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.180119 30335 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:28.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.181434 30335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:28.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.184365 30335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:28.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.185770 30335 hybrid_clock.cc:648] HybridClock initialized: now 1783476748185717 us; error 70 us; skew 500 ppm
02:12:28.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.186538 30335 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:28.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.193638 30335 webserver.cc:533] Webserver started at http://127.29.120.60:33809/ using document root <none> and password file <none>
02:12:28.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.194495 30335 fs_manager.cc:362] Metadata directory not provided
02:12:28.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.194694 30335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:28.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.195062 30335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:28.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.199262 30335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data/instance:
02:12:28.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6aea31a864e8493681df6c2f1f0bf751"
02:12:28.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:28 on dist-test-slave-3cc9"
02:12:28.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.200253 30335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal/instance:
02:12:28.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6aea31a864e8493681df6c2f1f0bf751"
02:12:28.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:28 on dist-test-slave-3cc9"
02:12:28.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.207212 30335 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
02:12:28.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.213044 30357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:28.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.214138 30335 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
02:12:28.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.214494 30335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal
02:12:28.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6aea31a864e8493681df6c2f1f0bf751"
02:12:28.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:28 on dist-test-slave-3cc9"
02:12:28.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.214861 30335 fs_report.cc:389] FS layout report
02:12:28.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:28.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal
02:12:28.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data/data
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:28.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:28.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:28.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:28.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.278944 30335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.280604 30335 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:28.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.281268 30335 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:28.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.357002 30335 rpc_server.cc:307] RPC server started. Bound to: 127.29.120.60:33989
02:12:28.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.357076 30408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.120.60:33989 every 8 connection(s)
02:12:28.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.360023 30335 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/data/info.pb
02:12:28.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.364933 30176 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 30335
02:12:28.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.365434 30176 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/master-2/wal/instance
02:12:28.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.367197 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:28.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.384182 30409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } has no permanent_uuid. Determining permanent_uuid...
02:12:28.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.393321 30256 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } attempt: 8
02:12:28.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.408849 30256 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } has no permanent_uuid. Determining permanent_uuid...
02:12:28.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.417882 30409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } has no permanent_uuid. Determining permanent_uuid...
02:12:28.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.429440 30409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } has no permanent_uuid. Determining permanent_uuid...
02:12:28.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.432461 30256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: Bootstrap starting.
02:12:28.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.440598 30256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: Neither blocks nor log segments found. Creating new log.
02:12:28.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.443194 30256 log.cc:826] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: Log is configured to *not* fsync() on all Append() calls
02:12:28.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.450027 30256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: No bootstrap required, opened a new log
02:12:28.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.451444 30409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751: Bootstrap starting.
02:12:28.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.458463 30409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751: Neither blocks nor log segments found. Creating new log.
02:12:28.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.460660 30409 log.cc:826] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751: Log is configured to *not* fsync() on all Append() calls
02:12:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.465613 30409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751: No bootstrap required, opened a new log
02:12:28.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.477082 30256 raft_consensus.cc:359] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.478207 30256 raft_consensus.cc:385] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:28.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.478529 30256 raft_consensus.cc:740] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54ac59214e7646a29c985e2568c0ff8b, State: Initialized, Role: FOLLOWER
02:12:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.479547 30256 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.482244 30422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:28.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.483081 30422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: This master's current role is: FOLLOWER
02:12:28.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.483589 30256 sys_catalog.cc:565] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: configured and running, proceeding with master startup.
02:12:28.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.491811 30409 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.492663 30409 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:28.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.492964 30409 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aea31a864e8493681df6c2f1f0bf751, State: Initialized, Role: FOLLOWER
02:12:28.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.494131 30409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.497687 30428 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:28.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.498206 30428 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.504024 30231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aea31a864e8493681df6c2f1f0bf751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54ac59214e7646a29c985e2568c0ff8b" is_pre_election: true
02:12:28.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.505223 30231 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aea31a864e8493681df6c2f1f0bf751 in term 0.
02:12:28.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.507758 30359 leader_election.cc:304] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54ac59214e7646a29c985e2568c0ff8b, 6aea31a864e8493681df6c2f1f0bf751; no voters: 
02:12:28.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.512753 30428 leader_election.cc:290] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54ac59214e7646a29c985e2568c0ff8b (127.29.120.62:38375), 181c75c7e0ca49d498e64ed6e9e7843c (127.29.120.61:40613)
02:12:28.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.513612 30428 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:28.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.514623 30428 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:28.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.512317 30432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:28.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.517462 30428 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 0 FOLLOWER]: Advancing to term 1
02:12:28.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.518662 30432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: This master's current role is: FOLLOWER
02:12:28.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.526886 30409 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: configured and running, proceeding with master startup.
02:12:28.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.528136 30428 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.536604 30363 tablet.cc:2406] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:28.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.536835 30231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aea31a864e8493681df6c2f1f0bf751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54ac59214e7646a29c985e2568c0ff8b"
02:12:28.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.537539 30231 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 0 FOLLOWER]: Advancing to term 1
02:12:28.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.552958 30428 leader_election.cc:290] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [CANDIDATE]: Term 1 election: Requested vote from peers 54ac59214e7646a29c985e2568c0ff8b (127.29.120.62:38375), 181c75c7e0ca49d498e64ed6e9e7843c (127.29.120.61:40613)
02:12:28.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.558043 30231 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aea31a864e8493681df6c2f1f0bf751 in term 1.
02:12:28.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.561537 30359 leader_election.cc:304] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54ac59214e7646a29c985e2568c0ff8b, 6aea31a864e8493681df6c2f1f0bf751; no voters: 
02:12:28.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.563179 30428 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 1 FOLLOWER]: Leader election won for term 1
02:12:28.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.565629 30428 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [term 1 LEADER]: Becoming Leader. State: Replica: 6aea31a864e8493681df6c2f1f0bf751, State: Running, Role: LEADER
02:12:28.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.573966 30438 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:12:28.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:28.574842 30210 tablet.cc:2406] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:28.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.573436 30428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.598371 30430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aea31a864e8493681df6c2f1f0bf751. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:28.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.599741 30430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: This master's current role is: LEADER
02:12:28.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.603951 30446 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:28.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.582674 30188 master_runner.cc:187] Error getting master registration for 127.29.120.61:40613: OK, instance_id { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" instance_seqno: 1783476746508512 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:28.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.619218 30188 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:28.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.622272 30446 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:28.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.647823 30231 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Refusing update from remote peer 6aea31a864e8493681df6c2f1f0bf751: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:28.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.649974 30430 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:28.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.637365 30335 master_runner.cc:187] Error getting master registration for 127.29.120.61:40613: OK, instance_id { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" instance_seqno: 1783476746508512 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:28.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.673159 30335 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:28.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.680795 30422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aea31a864e8493681df6c2f1f0bf751. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:28.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.681594 30422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: This master's current role is: FOLLOWER
02:12:28.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.689785 30430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:28.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.690523 30430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: This master's current role is: LEADER
02:12:28.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.695101 30422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:28.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.696179 30422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: This master's current role is: FOLLOWER
02:12:28.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.696628 30446 catalog_manager.cc:1383] Generated new cluster ID: 4e087cc50f4546dfaa28b4507804c841
02:12:28.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.697028 30446 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:28.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.742501 30446 catalog_manager.cc:1406] Generated new certificate authority record
02:12:28.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.744560 30446 catalog_manager.cc:1540] Loading token signing keys...
02:12:28.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.774010 30446 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751: Generated new TSK 0
02:12:28.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.775148 30446 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:28.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.789354 30176 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:28.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/logs
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data/info.pb
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:28.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.1:0
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.120.1
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.1
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:28.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:28.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.895263 30333 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } attempt: 7
02:12:28.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.921205 30333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: Bootstrap starting.
02:12:28.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.930200 30333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: Neither blocks nor log segments found. Creating new log.
02:12:28.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.933226 30333 log.cc:826] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: Log is configured to *not* fsync() on all Append() calls
02:12:28.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.945168 30333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: No bootstrap required, opened a new log
02:12:28.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.976953 30333 raft_consensus.cc:359] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:28.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.978396 30333 raft_consensus.cc:385] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:28.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.979034 30333 raft_consensus.cc:740] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181c75c7e0ca49d498e64ed6e9e7843c, State: Initialized, Role: FOLLOWER
02:12:28.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:28.980621 30333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:29.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.003911 30333 sys_catalog.cc:565] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: configured and running, proceeding with master startup.
02:12:29.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.004115 30307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aea31a864e8493681df6c2f1f0bf751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181c75c7e0ca49d498e64ed6e9e7843c"
02:12:29.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.005158 30306 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 0 FOLLOWER]: Advancing to term 1
02:12:29.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.009104 30308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aea31a864e8493681df6c2f1f0bf751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" is_pre_election: true
02:12:29.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.002965 30459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:29.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.016170 30459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: This master's current role is: FOLLOWER
02:12:29.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.019584 30306 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 1 FOLLOWER]: Refusing update from remote peer 6aea31a864e8493681df6c2f1f0bf751: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:29.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.021313 30430 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [LEADER]: Connected to new peer: Peer: permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:29.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.082671 30464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:29.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.084061 30464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: This master's current role is: FOLLOWER
02:12:29.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.083016 30459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aea31a864e8493681df6c2f1f0bf751. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:29.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.085016 30459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: This master's current role is: FOLLOWER
02:12:29.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.112627 30475 catalog_manager.cc:1295] Loaded cluster ID: 4e087cc50f4546dfaa28b4507804c841
02:12:29.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.113632 30475 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: loading cluster ID for follower catalog manager: success
02:12:29.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.126274 30475 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: acquiring CA information for follower catalog manager: success
02:12:29.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.132813 30475 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:29.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.299522 30456 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:29.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.300174 30456 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:29.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.300906 30456 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:29.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.361223 30456 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:29.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.363622 30456 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.120.1
02:12:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.428912 30456 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.1:0
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data/info.pb
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.1
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:29.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.120.1
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/logs
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:29.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.433946 30456 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:29.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.436625 30456 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:29.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.477566 30483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:29.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.480026 30482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6aea31a864e8493681df6c2f1f0bf751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:29.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.481392 30482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aea31a864e8493681df6c2f1f0bf751 [sys.catalog]: This master's current role is: LEADER
02:12:29.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.600843 30438 catalog_manager.cc:1295] Loaded cluster ID: 4e087cc50f4546dfaa28b4507804c841
02:12:29.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.608834 30438 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: loading cluster ID for follower catalog manager: success
02:12:29.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.616319 30438 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: acquiring CA information for follower catalog manager: success
02:12:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.631290 30438 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:30.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.493314 30489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:30.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:29.492573 30456 server_base.cc:1061] running on GCE node
02:12:30.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:29.491092 30484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:30.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.977427 30456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:30.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.987756 30456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:30.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.989550 30456 hybrid_clock.cc:648] HybridClock initialized: now 1783476750989498 us; error 62 us; skew 500 ppm
02:12:30.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:30.990988 30456 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:31.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.021524 30456 webserver.cc:533] Webserver started at http://127.29.120.1:41223/ using document root <none> and password file <none>
02:12:31.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.023316 30456 fs_manager.cc:362] Metadata directory not provided
02:12:31.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.023962 30456 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:31.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.024780 30456 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.037286 30456 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data/instance:
02:12:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d9a394511854f95b0ebe582d92f4125"
02:12:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:31 on dist-test-slave-3cc9"
02:12:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.039515 30456 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal/instance:
02:12:31.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d9a394511854f95b0ebe582d92f4125"
02:12:31.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:31 on dist-test-slave-3cc9"
02:12:31.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.055244 30456 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.006s	sys 0.007s
02:12:31.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.068810 30496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:31.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.070569 30456 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.006s	sys 0.005s
02:12:31.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.071269 30456 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal
02:12:31.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d9a394511854f95b0ebe582d92f4125"
02:12:31.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:31 on dist-test-slave-3cc9"
02:12:31.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.072033 30456 fs_report.cc:389] FS layout report
02:12:31.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:31.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal
02:12:31.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data/data
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:31.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.168704 30456 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:31.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.171160 30456 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:31.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.172091 30456 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:31.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.181625 30456 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:31.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.194047 30456 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:31.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.194713 30456 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
02:12:31.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.195240 30456 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:31.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.195640 30456 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:31.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.741196 30456 rpc_server.cc:307] RPC server started. Bound to: 127.29.120.1:34467
02:12:31.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.741364 30608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.120.1:34467 every 8 connection(s)
02:12:31.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.744800 30456 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/data/info.pb
02:12:31.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.749528 30176 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 30456
02:12:31.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.750118 30176 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-0/wal/instance
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.774572 30176 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/logs
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data/info.pb
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.2:0
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.120.2
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.2
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:31.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:31.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.902035 30610 heartbeater.cc:344] Connected to a master server at 127.29.120.61:40613
02:12:31.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.902630 30610 heartbeater.cc:461] Registering TS with master...
02:12:31.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.903995 30610 heartbeater.cc:507] Master 127.29.120.61:40613 requested a full tablet report, sending...
02:12:31.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.907717 30298 ts_manager.cc:194] Registered new tserver with Master: 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1:34467)
02:12:31.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.912840 30609 heartbeater.cc:344] Connected to a master server at 127.29.120.60:33989
02:12:31.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.913239 30609 heartbeater.cc:461] Registering TS with master...
02:12:31.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.914165 30609 heartbeater.cc:507] Master 127.29.120.60:33989 requested a full tablet report, sending...
02:12:31.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.916877 30374 ts_manager.cc:194] Registered new tserver with Master: 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1:34467)
02:12:31.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.919759 30614 heartbeater.cc:344] Connected to a master server at 127.29.120.62:38375
02:12:31.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.920107 30614 heartbeater.cc:461] Registering TS with master...
02:12:31.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.921094 30614 heartbeater.cc:507] Master 127.29.120.62:38375 requested a full tablet report, sending...
02:12:31.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.924400 30221 ts_manager.cc:194] Registered new tserver with Master: 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1:34467)
02:12:31.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:31.927125 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.120.1:46505
02:12:32.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.238461 30613 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:32.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.239107 30613 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:32.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.239694 30613 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:32.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.274025 30613 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:32.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.275027 30613 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.120.2
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.314603 30613 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.2:0
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data/info.pb
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.2
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.120.2
02:12:32.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/logs
02:12:32.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:32.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:32.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:32.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.316350 30613 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.318687 30613 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:32.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.336897 30627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:32.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.930759 30609 heartbeater.cc:499] Master 127.29.120.60:33989 was elected leader, sending a full tablet report...
02:12:33.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:32.350526 30613 server_base.cc:1061] running on GCE node
02:12:33.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:32.349257 30628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:33.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:33.585233 30631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:33.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.587615 30613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:33.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.590525 30613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:33.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.591964 30613 hybrid_clock.cc:648] HybridClock initialized: now 1783476753591900 us; error 57 us; skew 500 ppm
02:12:33.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.593040 30613 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:33.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.599337 30613 webserver.cc:533] Webserver started at http://127.29.120.2:36311/ using document root <none> and password file <none>
02:12:33.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.600199 30613 fs_manager.cc:362] Metadata directory not provided
02:12:33.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.600395 30613 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:33.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.600853 30613 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:33.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.605043 30613 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data/instance:
02:12:33.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04eca53f279b41b1b5ca0046b4429052"
02:12:33.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:33 on dist-test-slave-3cc9"
02:12:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.606062 30613 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal/instance:
02:12:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04eca53f279b41b1b5ca0046b4429052"
02:12:33.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:33 on dist-test-slave-3cc9"
02:12:33.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.613325 30613 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
02:12:33.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.619217 30638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:33.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.620575 30613 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
02:12:33.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.620980 30613 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal
02:12:33.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "04eca53f279b41b1b5ca0046b4429052"
02:12:33.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:33 on dist-test-slave-3cc9"
02:12:33.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.621434 30613 fs_report.cc:389] FS layout report
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data/data
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:33.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:33.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.705657 30613 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.707197 30613 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:33.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.707580 30613 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:33.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.710223 30613 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:33.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.714949 30613 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:33.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.715152 30613 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:33.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.715350 30613 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:33.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.715481 30613 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:33.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.870868 30613 rpc_server.cc:307] RPC server started. Bound to: 127.29.120.2:37087
02:12:33.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.871083 30750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.120.2:37087 every 8 connection(s)
02:12:33.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.873384 30613 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/data/info.pb
02:12:33.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.877604 30176 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 30613
02:12:33.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.878238 30176 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal/instance
02:12:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.900785 30176 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal
02:12:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data
02:12:33.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/logs
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data/info.pb
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:33.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.3:0
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.120.3
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.3
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:33.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.950850 30752 heartbeater.cc:344] Connected to a master server at 127.29.120.61:40613
02:12:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.951386 30752 heartbeater.cc:461] Registering TS with master...
02:12:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.951998 30751 heartbeater.cc:344] Connected to a master server at 127.29.120.60:33989
02:12:33.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.952346 30751 heartbeater.cc:461] Registering TS with master...
02:12:33.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.951395 30753 heartbeater.cc:344] Connected to a master server at 127.29.120.62:38375
02:12:33.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.952822 30752 heartbeater.cc:507] Master 127.29.120.61:40613 requested a full tablet report, sending...
02:12:33.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.953241 30753 heartbeater.cc:461] Registering TS with master...
02:12:33.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.953570 30751 heartbeater.cc:507] Master 127.29.120.60:33989 requested a full tablet report, sending...
02:12:33.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.954170 30753 heartbeater.cc:507] Master 127.29.120.62:38375 requested a full tablet report, sending...
02:12:33.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.956027 30374 ts_manager.cc:194] Registered new tserver with Master: 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087)
02:12:33.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.956465 30298 ts_manager.cc:194] Registered new tserver with Master: 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087)
02:12:33.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.957134 30221 ts_manager.cc:194] Registered new tserver with Master: 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087)
02:12:33.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:33.957795 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.120.2:39355
02:12:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.256060 30761 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.256541 30761 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:34.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.257058 30761 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:34.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.290088 30761 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.291141 30761 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.120.3
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.328554 30761 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.29.120.20:35157
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.29.120.3:0
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:34.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data/info.pb
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.29.120.3
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.29.120.62:38375,127.29.120.61:40613,127.29.120.60:33989
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.29.120.3
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/logs
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:34.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:34.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.329939 30761 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:34.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.331741 30761 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:34.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.347226 30768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:34.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:34.962049 30751 heartbeater.cc:499] Master 127.29.120.60:33989 was elected leader, sending a full tablet report...
02:12:35.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:34.348124 30769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:35.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.727299 30771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:35.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.731139 30770 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1381 milliseconds
02:12:35.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.731788 30761 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.384s	user 0.406s	sys 0.921s
02:12:35.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:35.732071 30761 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.385s	user 0.406s	sys 0.921s
02:12:35.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.732364 30761 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:35.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.733558 30761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:35.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.735863 30761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:35.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.737259 30761 hybrid_clock.cc:648] HybridClock initialized: now 1783476755737207 us; error 50 us; skew 500 ppm
02:12:35.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.738418 30761 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:35.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.748396 30761 webserver.cc:533] Webserver started at http://127.29.120.3:37939/ using document root <none> and password file <none>
02:12:35.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.749720 30761 fs_manager.cc:362] Metadata directory not provided
02:12:35.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.750005 30761 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:35.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.750574 30761 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:35.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.756356 30761 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data/instance:
02:12:35.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8505a9410e9422e8256696c278eef10"
02:12:35.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:35 on dist-test-slave-3cc9"
02:12:35.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.757473 30761 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal/instance:
02:12:35.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8505a9410e9422e8256696c278eef10"
02:12:35.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:35 on dist-test-slave-3cc9"
02:12:35.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.768229 30761 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.007s	sys 0.003s
02:12:35.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.775372 30780 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:35.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.776587 30761 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
02:12:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.776969 30761 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal
02:12:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f8505a9410e9422e8256696c278eef10"
02:12:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:35 on dist-test-slave-3cc9"
02:12:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.777288 30761 fs_report.cc:389] FS layout report
02:12:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:35.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data/data
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:35.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:35.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.863286 30761 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:35.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.864991 30761 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:35.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.865587 30761 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:35.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.869645 30761 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:35.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.874563 30761 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:35.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.874799 30761 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:35.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.875134 30761 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:35.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:35.875341 30761 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:36.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.050040 30761 rpc_server.cc:307] RPC server started. Bound to: 127.29.120.3:35027
02:12:36.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.050177 30892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.120.3:35027 every 8 connection(s)
02:12:36.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.053766 30761 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/data/info.pb
02:12:36.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.059407 30176 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 30761
02:12:36.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.059868 30176 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-2/wal/instance
02:12:36.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.113174 30896 heartbeater.cc:344] Connected to a master server at 127.29.120.62:38375
02:12:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.113410 30893 heartbeater.cc:344] Connected to a master server at 127.29.120.60:33989
02:12:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.113716 30896 heartbeater.cc:461] Registering TS with master...
02:12:36.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.113893 30893 heartbeater.cc:461] Registering TS with master...
02:12:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.115243 30893 heartbeater.cc:507] Master 127.29.120.60:33989 requested a full tablet report, sending...
02:12:36.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.115212 30896 heartbeater.cc:507] Master 127.29.120.62:38375 requested a full tablet report, sending...
02:12:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.118538 30374 ts_manager.cc:194] Registered new tserver with Master: f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027)
02:12:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.119438 30220 ts_manager.cc:194] Registered new tserver with Master: f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027)
02:12:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.119943 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.29.120.3:38063
02:12:36.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.120335 30894 heartbeater.cc:344] Connected to a master server at 127.29.120.61:40613
02:12:36.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.120718 30894 heartbeater.cc:461] Registering TS with master...
02:12:36.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.121816 30894 heartbeater.cc:507] Master 127.29.120.61:40613 requested a full tablet report, sending...
02:12:36.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.124719 30298 ts_manager.cc:194] Registered new tserver with Master: f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027)
02:12:36.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:36.142161 30176 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:12:36.155 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:36.156 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:12:36.166 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.29.120.62"
      port: 38375
    }
    bound_http_address {
      host: "127.29.120.62"
      port: 34007
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.29.120.61"
      port: 40613
    }
    bound_http_address {
      host: "127.29.120.61"
      port: 44727
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.29.120.60"
      port: 33989
    }
    bound_http_address {
      host: "127.29.120.60"
      port: 33809
    }
  }
}

02:12:36.169 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:12:36.172 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.29.120.1"
      port: 34467
    }
    bound_http_address {
      host: "127.29.120.1"
      port: 41223
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.29.120.2"
      port: 37087
    }
    bound_http_address {
      host: "127.29.120.2"
      port: 36311
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.29.120.3"
      port: 35027
    }
    bound_http_address {
      host: "127.29.120.3"
      port: 37939
    }
  }
}

02:12:36.173 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:12:36.346 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
02:12:36.410 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:12:36.571 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.29.120.61:40613(127.29.120.61:40613)] connecting to peer
02:12:36.620 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:36.622 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.29.120.62:38375(127.29.120.62:38375)] connecting to peer
02:12:36.639 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.29.120.60:33989(127.29.120.60:33989)] Successfully connected to peer
02:12:36.641 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.29.120.62:38375(127.29.120.62:38375)] Successfully connected to peer
02:12:36.642 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.29.120.61:40613(127.29.120.61:40613)] Successfully connected to peer
02:12:36.738 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.29.120.62
02:12:36.741 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.29.120.61
02:12:36.742 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.29.120.60
02:12:36.996 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xa522b927, L:/127.0.0.1:43276 - R:/127.29.120.60:33989] using SASL/PLAIN
02:12:36.996 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x601f08fa, L:/127.0.0.1:56638 - R:/127.29.120.61:40613] using SASL/PLAIN
02:12:36.996 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x7112d4e7, L:/127.0.0.1:33306 - R:/127.29.120.62:38375] using SASL/PLAIN
02:12:37.035 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:37.036 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=514), Traces: [0ms] refreshing cache from master, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [485ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [485ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [486ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: OK, deferred=null) after lookup
02:12:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.087175 30374 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43276:
02:12:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
02:12:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:12:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:37.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:12:37.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:37.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:37.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:37.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:37.091089 30374 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:12:37.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.124078 30893 heartbeater.cc:499] Master 127.29.120.60:33989 was elected leader, sending a full tablet report...
02:12:37.175 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table b9f9f67f344c4409a79e484ea58d6cfe
02:12:37.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.203379 30544 tablet_service.cc:1511] Processing CreateTablet for tablet ec5f6c96ce644f5eb904ba2da4f80dec (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=b9f9f67f344c4409a79e484ea58d6cfe]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:37.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.207319 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5f6c96ce644f5eb904ba2da4f80dec. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:37.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.214445 30686 tablet_service.cc:1511] Processing CreateTablet for tablet ec5f6c96ce644f5eb904ba2da4f80dec (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=b9f9f67f344c4409a79e484ea58d6cfe]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:37.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.216084 30686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5f6c96ce644f5eb904ba2da4f80dec. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:37.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.228590 30828 tablet_service.cc:1511] Processing CreateTablet for tablet ec5f6c96ce644f5eb904ba2da4f80dec (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=b9f9f67f344c4409a79e484ea58d6cfe]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:37.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.230345 30828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5f6c96ce644f5eb904ba2da4f80dec. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:37.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.235754 30929 tablet_bootstrap.cc:492] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Bootstrap starting.
02:12:37.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.243583 30929 tablet_bootstrap.cc:654] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Neither blocks nor log segments found. Creating new log.
02:12:37.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.245571 30930 tablet_bootstrap.cc:492] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Bootstrap starting.
02:12:37.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.249250 30929 log.cc:826] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Log is configured to *not* fsync() on all Append() calls
02:12:37.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.252988 30930 tablet_bootstrap.cc:654] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Neither blocks nor log segments found. Creating new log.
02:12:37.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.254868 30930 log.cc:826] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Log is configured to *not* fsync() on all Append() calls
02:12:37.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.255002 30929 tablet_bootstrap.cc:492] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: No bootstrap required, opened a new log
02:12:37.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.256294 30929 ts_tablet_manager.cc:1403] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
02:12:37.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.260459 30933 tablet_bootstrap.cc:492] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: Bootstrap starting.
02:12:37.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.260601 30930 tablet_bootstrap.cc:492] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: No bootstrap required, opened a new log
02:12:37.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.261137 30930 ts_tablet_manager.cc:1403] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
02:12:37.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.269883 30933 tablet_bootstrap.cc:654] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: Neither blocks nor log segments found. Creating new log.
02:12:37.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.272064 30933 log.cc:826] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: Log is configured to *not* fsync() on all Append() calls
02:12:37.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.277587 30933 tablet_bootstrap.cc:492] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: No bootstrap required, opened a new log
02:12:37.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.278105 30933 ts_tablet_manager.cc:1403] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
02:12:37.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.288035 30929 raft_consensus.cc:359] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.289467 30929 raft_consensus.cc:385] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:37.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.289964 30929 raft_consensus.cc:740] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d9a394511854f95b0ebe582d92f4125, State: Initialized, Role: FOLLOWER
02:12:37.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.292074 30929 consensus_queue.cc:260] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.294257 30930 raft_consensus.cc:359] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.295158 30930 raft_consensus.cc:385] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:37.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.297394 30929 ts_tablet_manager.cc:1434] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Time spent starting tablet: real 0.041s	user 0.027s	sys 0.007s
02:12:37.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.305634 30933 raft_consensus.cc:359] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.306556 30933 raft_consensus.cc:385] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:37.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.306939 30933 raft_consensus.cc:740] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8505a9410e9422e8256696c278eef10, State: Initialized, Role: FOLLOWER
02:12:37.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.295480 30930 raft_consensus.cc:740] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04eca53f279b41b1b5ca0046b4429052, State: Initialized, Role: FOLLOWER
02:12:37.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.307930 30933 consensus_queue.cc:260] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.310173 30930 consensus_queue.cc:260] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.325956 30930 ts_tablet_manager.cc:1434] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Time spent starting tablet: real 0.065s	user 0.029s	sys 0.016s
02:12:37.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.326602 30933 ts_tablet_manager.cc:1434] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: Time spent starting tablet: real 0.048s	user 0.029s	sys 0.019s
02:12:37.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:37.349793 30900 tablet.cc:2406] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:37.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:37.373131 30619 tablet.cc:2406] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:37.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:37.417089 30758 tablet.cc:2406] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:37.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.465482 30936 raft_consensus.cc:493] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:37.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.465962 30936 raft_consensus.cc:515] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.468907 30936 leader_election.cc:290] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1:34467), 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087)
02:12:37.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.482550 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "f8505a9410e9422e8256696c278eef10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04eca53f279b41b1b5ca0046b4429052" is_pre_election: true
02:12:37.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.482748 30564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "f8505a9410e9422e8256696c278eef10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d9a394511854f95b0ebe582d92f4125" is_pre_election: true
02:12:37.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.483268 30706 raft_consensus.cc:2468] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8505a9410e9422e8256696c278eef10 in term 0.
02:12:37.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.483561 30564 raft_consensus.cc:2468] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8505a9410e9422e8256696c278eef10 in term 0.
02:12:37.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.484592 30781 leader_election.cc:304] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04eca53f279b41b1b5ca0046b4429052, f8505a9410e9422e8256696c278eef10; no voters: 
02:12:37.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.485513 30936 raft_consensus.cc:2804] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:37.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.485810 30936 raft_consensus.cc:493] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:37.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.486169 30936 raft_consensus.cc:3060] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 0 FOLLOWER]: Advancing to term 1
02:12:37.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.490929 30936 raft_consensus.cc:515] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.492628 30936 leader_election.cc:290] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [CANDIDATE]: Term 1 election: Requested vote from peers 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1:34467), 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087)
02:12:37.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.493577 30564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "f8505a9410e9422e8256696c278eef10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d9a394511854f95b0ebe582d92f4125"
02:12:37.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.493754 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "f8505a9410e9422e8256696c278eef10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04eca53f279b41b1b5ca0046b4429052"
02:12:37.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.494139 30706 raft_consensus.cc:3060] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 0 FOLLOWER]: Advancing to term 1
02:12:37.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.494032 30564 raft_consensus.cc:3060] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 0 FOLLOWER]: Advancing to term 1
02:12:37.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.498509 30564 raft_consensus.cc:2468] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8505a9410e9422e8256696c278eef10 in term 1.
02:12:37.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.498533 30706 raft_consensus.cc:2468] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8505a9410e9422e8256696c278eef10 in term 1.
02:12:37.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.499958 30784 leader_election.cc:304] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d9a394511854f95b0ebe582d92f4125, f8505a9410e9422e8256696c278eef10; no voters: 
02:12:37.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.500815 30936 raft_consensus.cc:2804] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 1 FOLLOWER]: Leader election won for term 1
02:12:37.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.502862 30936 raft_consensus.cc:697] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [term 1 LEADER]: Becoming Leader. State: Replica: f8505a9410e9422e8256696c278eef10, State: Running, Role: LEADER
02:12:37.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.503656 30936 consensus_queue.cc:237] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:37.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.517059 30374 catalog_manager.cc:5697] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8505a9410e9422e8256696c278eef10 (127.29.120.3). New cstate: current_term: 1 leader_uuid: "f8505a9410e9422e8256696c278eef10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } health_report { overall_health: HEALTHY } } }
02:12:37.690 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table b9f9f67f344c4409a79e484ea58d6cfe
02:12:37.708 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet ec5f6c96ce644f5eb904ba2da4f80dec for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:12:37.717 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299992, tablet=ec5f6c96ce644f5eb904ba2da4f80dec@[04eca53f279b41b1b5ca0046b4429052(127.29.120.2:37087),3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467),f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)[L]]}]
02:12:37.719 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.29.120.60:33989, [9ms] Sub RPC GetTableLocations: received response from server master-127.29.120.60:33989: OK, deferred=null) after lookup
02:12:37.731 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] connecting to peer
02:12:37.734 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] Successfully connected to peer
02:12:37.827 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0xdd952bad, L:/127.0.0.1:59578 - R:/127.29.120.3:35027] using TOKEN/null
02:12:37.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.840974 30706 raft_consensus.cc:1275] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 1 FOLLOWER]: Refusing update from remote peer f8505a9410e9422e8256696c278eef10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:37.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.842010 30564 raft_consensus.cc:1275] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Refusing update from remote peer f8505a9410e9422e8256696c278eef10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:37.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.843863 30936 consensus_queue.cc:1048] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:37.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.844882 30940 consensus_queue.cc:1048] T ec5f6c96ce644f5eb904ba2da4f80dec P f8505a9410e9422e8256696c278eef10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:12:37.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.868595 30944 mvcc.cc:204] Tried to move back new op lower bound from 7305120800098758656 to 7305120798743621632. Current Snapshot: MvccSnapshot[applied={T|T < 7305120800098758656}]
02:12:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:37.961632 30948 mvcc.cc:204] Tried to move back new op lower bound from 7305120800098758656 to 7305120798743621632. Current Snapshot: MvccSnapshot[applied={T|T < 7305120800098758656}]
02:12:38.223 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=ec5f6c96ce644f5eb904ba2da4f80dec, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:12:38.225 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.29.120.60:33989
02:12:38.226 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:12:38.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:38.227335 30176 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 30335
02:12:38.264 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.29.120.60:33989(127.29.120.60:33989)] handling channelInactive
02:12:38.265 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:12:38.266 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.29.120.3:35027
02:12:38.267 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

02:12:38.270 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state READY due to: connection closed
02:12:38.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:38.267349 30176 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 30761
02:12:38.303 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:12:38.303 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] handling channelInactive
02:12:38.303 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] cleaning up while in state READY due to: connection closed
02:12:38.304 [DEBUG - Time-limited test] (Connection.java:748) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] connecting to peer
02:12:38.308 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027): Connection refused: /127.29.120.3:35027
02:12:38.308 [DEBUG - kudu-nio-4] (Connection.java:709) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] cleaning up while in state CONNECTING due to: Failed to connect to peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027): Connection refused: /127.29.120.3:35027
02:12:38.309 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location f8505a9410e9422e8256696c278eef10(127.29.120.3:35027) for tablet ec5f6c96ce644f5eb904ba2da4f80dec: Failed to connect to peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027): Connection refused: /127.29.120.3:35027
02:12:38.324 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.326 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.326 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.327 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.29.120.60:33989(127.29.120.60:33989) for tablet Kudu Master: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.343 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.346 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.346 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.346 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.352 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.364 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.368 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.368 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.368 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.371 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.384 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.385 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.386 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.386 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.390 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.424 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.425 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.426 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.426 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.428 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.463 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.465 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.466 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.466 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.467 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.483 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.485 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.485 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.485 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.488 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.604 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.605 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.605 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.606 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.608 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.744 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:38.747 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.747 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.747 [INFO - pool-2-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:38.751 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:38.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:38.925460 30609 heartbeater.cc:646] Failed to heartbeat to 127.29.120.60:33989 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:39.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.003929 30751 heartbeater.cc:646] Failed to heartbeat to 127.29.120.60:33989 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:39.144 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:39.145 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:39.145 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:39.146 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:39.148 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375; will retry
02:12:39.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.475945 30964 raft_consensus.cc:493] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6aea31a864e8493681df6c2f1f0bf751)
02:12:39.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.476430 30964 raft_consensus.cc:515] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:39.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.478508 30964 leader_election.cc:290] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54ac59214e7646a29c985e2568c0ff8b (127.29.120.62:38375), 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989)
02:12:39.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.479596 30231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "54ac59214e7646a29c985e2568c0ff8b" is_pre_election: true
02:12:39.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.481333 30285 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111) [suppressed 6 similar messages]
02:12:39.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.484261 30285 leader_election.cc:336] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989): Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:39.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.484567 30285 leader_election.cc:304] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 181c75c7e0ca49d498e64ed6e9e7843c; no voters: 54ac59214e7646a29c985e2568c0ff8b, 6aea31a864e8493681df6c2f1f0bf751
02:12:39.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.485301 30964 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:12:39.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.513268 30967 raft_consensus.cc:493] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6aea31a864e8493681df6c2f1f0bf751)
02:12:39.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.513701 30967 raft_consensus.cc:515] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:39.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.515594 30967 leader_election.cc:290] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 181c75c7e0ca49d498e64ed6e9e7843c (127.29.120.61:40613), 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989)
02:12:39.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.516623 30308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54ac59214e7646a29c985e2568c0ff8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" is_pre_election: true
02:12:39.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.517388 30308 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54ac59214e7646a29c985e2568c0ff8b in term 1.
02:12:39.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.518173 30208 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111) [suppressed 7 similar messages]
02:12:39.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.518478 30207 leader_election.cc:304] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181c75c7e0ca49d498e64ed6e9e7843c, 54ac59214e7646a29c985e2568c0ff8b; no voters: 
02:12:39.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.519452 30967 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Leader pre-election won for term 2
02:12:39.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.519822 30967 raft_consensus.cc:493] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6aea31a864e8493681df6c2f1f0bf751)
02:12:39.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.520170 30967 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 1 FOLLOWER]: Advancing to term 2
02:12:39.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.521693 30208 leader_election.cc:336] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989): Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:39.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.525422 30967 raft_consensus.cc:515] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:39.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.527704 30308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54ac59214e7646a29c985e2568c0ff8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "181c75c7e0ca49d498e64ed6e9e7843c"
02:12:39.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.527052 30967 leader_election.cc:290] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [CANDIDATE]: Term 2 election: Requested vote from peers 181c75c7e0ca49d498e64ed6e9e7843c (127.29.120.61:40613), 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989)
02:12:39.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.528205 30308 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 1 FOLLOWER]: Advancing to term 2
02:12:39.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.530598 30208 leader_election.cc:336] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989): Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111)
02:12:39.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.536417 30308 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54ac59214e7646a29c985e2568c0ff8b in term 2.
02:12:39.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.537475 30207 leader_election.cc:304] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 181c75c7e0ca49d498e64ed6e9e7843c, 54ac59214e7646a29c985e2568c0ff8b; no voters: 6aea31a864e8493681df6c2f1f0bf751
02:12:39.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.538074 30967 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 2 FOLLOWER]: Leader election won for term 2
02:12:39.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.539040 30967 raft_consensus.cc:697] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [term 2 LEADER]: Becoming Leader. State: Replica: 54ac59214e7646a29c985e2568c0ff8b, State: Running, Role: LEADER
02:12:39.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.539820 30967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } }
02:12:39.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.543735 30970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54ac59214e7646a29c985e2568c0ff8b. Latest consensus state: current_term: 2 leader_uuid: "54ac59214e7646a29c985e2568c0ff8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:39.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.544381 30970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: This master's current role is: LEADER
02:12:39.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.546147 30972 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:39.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.555044 30972 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=b9f9f67f344c4409a79e484ea58d6cfe]
02:12:39.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.561482 30972 tablet_loader.cc:96] loaded metadata for tablet ec5f6c96ce644f5eb904ba2da4f80dec (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=b9f9f67f344c4409a79e484ea58d6cfe])
02:12:39.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.562862 30972 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:39.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.566658 30972 catalog_manager.cc:1295] Loaded cluster ID: 4e087cc50f4546dfaa28b4507804c841
02:12:39.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.566908 30972 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:39.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.570436 30972 catalog_manager.cc:1540] Loading token signing keys...
02:12:39.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.572958 30972 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: Loaded TSK: 0
02:12:39.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.573880 30972 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:39.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.659274 30973 raft_consensus.cc:493] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8505a9410e9422e8256696c278eef10)
02:12:39.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.659965 30973 raft_consensus.cc:515] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:39.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.663074 30973 leader_election.cc:290] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087), f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027)
02:12:39.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.663383 30974 raft_consensus.cc:493] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8505a9410e9422e8256696c278eef10)
02:12:39.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.664160 30974 raft_consensus.cc:515] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:39.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.669621 30974 leader_election.cc:290] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1:34467), f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027)
02:12:39.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.669710 30497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111)
02:12:39.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.682808 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "3d9a394511854f95b0ebe582d92f4125" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "04eca53f279b41b1b5ca0046b4429052" is_pre_election: true
02:12:39.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.682859 30497 leader_election.cc:336] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027): Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111)
02:12:39.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.683487 30706 raft_consensus.cc:2468] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d9a394511854f95b0ebe582d92f4125 in term 1.
02:12:39.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.684434 30639 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111)
02:12:39.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.687152 30497 leader_election.cc:304] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04eca53f279b41b1b5ca0046b4429052, 3d9a394511854f95b0ebe582d92f4125; no voters: f8505a9410e9422e8256696c278eef10
02:12:39.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.687942 30973 raft_consensus.cc:2804] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:12:39.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.688301 30973 raft_consensus.cc:493] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8505a9410e9422e8256696c278eef10)
02:12:39.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.688640 30973 raft_consensus.cc:3060] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 1 FOLLOWER]: Advancing to term 2
02:12:39.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.689733 30639 leader_election.cc:336] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027): Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111)
02:12:39.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.693780 30564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "04eca53f279b41b1b5ca0046b4429052" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3d9a394511854f95b0ebe582d92f4125" is_pre_election: true
02:12:39.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.695142 30973 raft_consensus.cc:515] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:39.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.696031 30564 raft_consensus.cc:2393] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04eca53f279b41b1b5ca0046b4429052 in current term 2: Already voted for candidate 3d9a394511854f95b0ebe582d92f4125 in this term.
02:12:39.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.697237 30973 leader_election.cc:290] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [CANDIDATE]: Term 2 election: Requested vote from peers 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087), f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027)
02:12:39.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.697738 30706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5f6c96ce644f5eb904ba2da4f80dec" candidate_uuid: "3d9a394511854f95b0ebe582d92f4125" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "04eca53f279b41b1b5ca0046b4429052"
02:12:39.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.698205 30706 raft_consensus.cc:3060] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 1 FOLLOWER]: Advancing to term 2
02:12:39.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.701982 30497 leader_election.cc:336] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027): Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111)
02:12:39.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.702351 30642 leader_election.cc:304] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04eca53f279b41b1b5ca0046b4429052; no voters: 3d9a394511854f95b0ebe582d92f4125, f8505a9410e9422e8256696c278eef10
02:12:39.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.703470 30706 raft_consensus.cc:2468] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d9a394511854f95b0ebe582d92f4125 in term 2.
02:12:39.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.703881 30974 raft_consensus.cc:2749] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:12:39.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.704569 30497 leader_election.cc:304] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04eca53f279b41b1b5ca0046b4429052, 3d9a394511854f95b0ebe582d92f4125; no voters: f8505a9410e9422e8256696c278eef10
02:12:39.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.705199 30973 raft_consensus.cc:2804] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 2 FOLLOWER]: Leader election won for term 2
02:12:39.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.706864 30973 raft_consensus.cc:697] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 2 LEADER]: Becoming Leader. State: Replica: 3d9a394511854f95b0ebe582d92f4125, State: Running, Role: LEADER
02:12:39.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.708004 30973 consensus_queue.cc:237] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } }
02:12:39.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.718523 30221 catalog_manager.cc:5697] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 reported cstate change: term changed from 1 to 2, leader changed from f8505a9410e9422e8256696c278eef10 (127.29.120.3) to 3d9a394511854f95b0ebe582d92f4125 (127.29.120.1). New cstate: current_term: 2 leader_uuid: "3d9a394511854f95b0ebe582d92f4125" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9a394511854f95b0ebe582d92f4125" member_type: VOTER last_known_addr { host: "127.29.120.1" port: 34467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8505a9410e9422e8256696c278eef10" member_type: VOTER last_known_addr { host: "127.29.120.3" port: 35027 } health_report { overall_health: UNKNOWN } } }
02:12:39.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.726308 30308 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [term 2 FOLLOWER]: Refusing update from remote peer 54ac59214e7646a29c985e2568c0ff8b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
02:12:39.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.727830 30970 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
02:12:39.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:39.728514 30208 consensus_peers.cc:597] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b -> Peer 6aea31a864e8493681df6c2f1f0bf751 (127.29.120.60:33989): Couldn't send request to peer 6aea31a864e8493681df6c2f1f0bf751. Status: Network error: Client connection negotiation failed: client connection to 127.29.120.60:33989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:12:39.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.733712 30964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54ac59214e7646a29c985e2568c0ff8b. Latest consensus state: current_term: 2 leader_uuid: "54ac59214e7646a29c985e2568c0ff8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:39.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.734297 30964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: This master's current role is: FOLLOWER
02:12:39.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.737144 30967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "54ac59214e7646a29c985e2568c0ff8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:39.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.737819 30967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b [sys.catalog]: This master's current role is: LEADER
02:12:39.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.738732 30986 mvcc.cc:204] Tried to move back new op lower bound from 7305120807826145280 to 7305120807082938368. Current Snapshot: MvccSnapshot[applied={T|T < 7305120807826145280}]
02:12:39.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.740603 30964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "54ac59214e7646a29c985e2568c0ff8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54ac59214e7646a29c985e2568c0ff8b" member_type: VOTER last_known_addr { host: "127.29.120.62" port: 38375 } } peers { permanent_uuid: "181c75c7e0ca49d498e64ed6e9e7843c" member_type: VOTER last_known_addr { host: "127.29.120.61" port: 40613 } } peers { permanent_uuid: "6aea31a864e8493681df6c2f1f0bf751" member_type: VOTER last_known_addr { host: "127.29.120.60" port: 33989 } } }
02:12:39.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:39.741585 30964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 181c75c7e0ca49d498e64ed6e9e7843c [sys.catalog]: This master's current role is: FOLLOWER
02:12:39.984 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.29.120.60:33989(127.29.120.60:33989)] connecting to peer
02:12:39.986 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:39.986 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.29.120.60:33989(127.29.120.60:33989)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:39.987 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.29.120.60:33989: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989
02:12:39.991 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:39.992 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29980, elapsed=1667), Traces: [0ms] sending RPC to server master-127.29.120.60:33989, [3ms] received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [19ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [23ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [24ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [30ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [44ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [45ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [48ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [49ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [63ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [64ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [67ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [103ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [105ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [106ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [139ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [143ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [144ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [144ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [144ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [159ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [164ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [165ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [165ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [282ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [284ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [285ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [285ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [420ms] refreshing cache from master, [420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [424ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [425ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [428ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [428ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [822ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [823ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [825ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [825ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [826ms] delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [1660ms] refreshing cache from master, [1660ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [1661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [1662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [1664ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [1667ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, deferred=Deferred@235471456(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@89357656 after retry RPC after error@1843210571) -> (continuation of Deferred@1050188309 after retry RPC after error@2026145188) -> (continuation of Deferred@1717800537 after retry RPC after error@1651532975) -> (continuation of Deferred@415367878 after retry RPC after error@1148669407) -> (continuation of Deferred@1042027086 after retry RPC after error@1596480574) -> (continuation of Deferred@1475653935 after retry RPC after error@689117115) -> (continuation of Deferred@2000940725 after retry RPC after error@1788315087) -> (continuation of Deferred@404241531 after retry RPC after error@696733196) -> (continuation of Deferred@1104751567 after retry RPC after error@397834182), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@89357656 after retry RPC after error@1843210571) -> (continuation of Deferred@1050188309 after retry RPC after error@2026145188) -> (continuation of Deferred@1717800537 after retry RPC after error@1651532975) -> (continuation of Deferred@415367878 after retry RPC after error@1148669407) -> (continuation of Deferred@1042027086 after retry RPC after error@1596480574) -> (continuation of Deferred@1475653935 after retry RPC after error@689117115) -> (continuation of Deferred@2000940725 after retry RPC after error@1788315087) -> (continuation of Deferred@404241531 after retry RPC after error@696733196) -> (continuation of Deferred@1104751567 after retry RPC after error@397834182))) after lookup
02:12:39.997 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ec5f6c96ce644f5eb904ba2da4f80dec for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:12:39.998 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ec5f6c96ce644f5eb904ba2da4f80dec@[04eca53f279b41b1b5ca0046b4429052(127.29.120.2:37087),3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467)[L],f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)]}]
02:12:39.999 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ec5f6c96ce644f5eb904ba2da4f80dec, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1695), Traces: [0ms] sending RPC to server f8505a9410e9422e8256696c278eef10, [5ms] received response from server f8505a9410e9422e8256696c278eef10: Network error: Failed to connect to peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027): Connection refused: /127.29.120.3:35027, [5ms] delaying RPC due to: Network error: Failed to connect to peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027): Connection refused: /127.29.120.3:35027, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.29.120.60:33989, [22ms] Sub RPC GetTableLocations: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [23ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [38ms] Sub RPC GetTableLocations: refreshing cache from master, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [39ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [42ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [43ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [49ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [59ms] Sub RPC GetTableLocations: refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [64ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [67ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [79ms] Sub RPC GetTableLocations: refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [82ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [83ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [86ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [86ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [119ms] Sub RPC GetTableLocations: refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [122ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [124ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [124ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [158ms] Sub RPC GetTableLocations: refreshing cache from master, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [159ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [162ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [163ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [163ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [163ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [178ms] Sub RPC GetTableLocations: refreshing cache from master, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [181ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [183ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [184ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [184ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [299ms] Sub RPC GetTableLocations: refreshing cache from master, [299ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [301ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [303ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [304ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [304ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [439ms] Sub RPC GetTableLocations: refreshing cache from master, [439ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [440ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [443ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [447ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [447ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [839ms] Sub RPC GetTableLocations: refreshing cache from master, [839ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [842ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [844ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [844ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [845ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.29.120.61:40613,127.29.120.60:33989,127.29.120.62:38375) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [1679ms] Sub RPC GetTableLocations: refreshing cache from master, [1679ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.61:40613, [1680ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.60:33989, [1681ms] Sub RPC ConnectToMaster: sending RPC to server master-127.29.120.62:38375, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.60:33989: Network error: Failed to connect to peer master-127.29.120.60:33989(127.29.120.60:33989): Connection refused: /127.29.120.60:33989, [1683ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.61:40613: OK, [1686ms] Sub RPC ConnectToMaster: received response from server master-127.29.120.62:38375: OK, [1689ms] Sub RPC GetTableLocations: sending RPC to server master-127.29.120.62:38375, [1693ms] Sub RPC GetTableLocations: received response from server master-127.29.120.62:38375: OK, deferred=Deferred@1567668815(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@55ff757d -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@71532043 -> wakeup thread Time-limited test)) after lookup
02:12:40.001 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467)] connecting to peer
02:12:40.002 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467)] Successfully connected to peer
02:12:40.028 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x7746945d, L:/127.0.0.1:45518 - R:/127.29.120.1:34467] using TOKEN/null
02:12:40.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.037554 30706 raft_consensus.cc:1275] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 2 FOLLOWER]: Refusing update from remote peer 3d9a394511854f95b0ebe582d92f4125: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
02:12:40.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.038939 30973 consensus_queue.cc:1048] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04eca53f279b41b1b5ca0046b4429052" member_type: VOTER last_known_addr { host: "127.29.120.2" port: 37087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
02:12:40.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.040329 30497 consensus_peers.cc:597] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 -> Peer f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027): Couldn't send request to peer f8505a9410e9422e8256696c278eef10. Status: Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:12:40.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.043098 30753 heartbeater.cc:499] Master 127.29.120.62:38375 was elected leader, sending a full tablet report...
02:12:40.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.057444 30614 heartbeater.cc:499] Master 127.29.120.62:38375 was elected leader, sending a full tablet report...
02:12:40.214 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=ec5f6c96ce644f5eb904ba2da4f80dec, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:12:40.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.220646 30221 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33306:
02:12:40.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
02:12:40.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.221225 30221 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33306:
02:12:40.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
02:12:40.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.237957 30221 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 54ac59214e7646a29c985e2568c0ff8b: Sending DeleteTablet for 3 replicas of tablet ec5f6c96ce644f5eb904ba2da4f80dec
02:12:40.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.274607 30686 tablet_service.cc:1558] Processing DeleteTablet for tablet ec5f6c96ce644f5eb904ba2da4f80dec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 02:12:40 UTC) from {username='slave'} at 127.0.0.1:42268
02:12:40.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.280725 31005 tablet_replica.cc:333] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: stopping tablet replica
02:12:40.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.281881 31005 raft_consensus.cc:2243] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 2 FOLLOWER]: Raft consensus shutting down.
02:12:40.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:40.282361 30205 catalog_manager.cc:4755] TS f8505a9410e9422e8256696c278eef10 (127.29.120.3:35027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec5f6c96ce644f5eb904ba2da4f80dec: Network error: Client connection negotiation failed: client connection to 127.29.120.3:35027: connect: Connection refused (error 111)
02:12:40.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.283969 30544 tablet_service.cc:1558] Processing DeleteTablet for tablet ec5f6c96ce644f5eb904ba2da4f80dec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 02:12:40 UTC) from {username='slave'} at 127.0.0.1:45530
02:12:40.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.289855 31006 tablet_replica.cc:333] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: stopping tablet replica
02:12:40.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.289853 31005 raft_consensus.cc:2272] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052 [term 2 FOLLOWER]: Raft consensus is shut down!
02:12:40.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.291057 31006 raft_consensus.cc:2243] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 2 LEADER]: Raft consensus shutting down.
02:12:40.293 [DEBUG - main] (Connection.java:575) [peer f8505a9410e9422e8256696c278eef10(127.29.120.3:35027)] disconnecting while in state TERMINATED
02:12:40.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.293627 31005 ts_tablet_manager.cc:1916] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Deleting tablet data with delete state TABLET_DATA_DELETED
02:12:40.294 [DEBUG - main] (Connection.java:575) [peer 3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467)] disconnecting while in state READY
02:12:40.300 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467)] handling channelInactive
02:12:40.301 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 3d9a394511854f95b0ebe582d92f4125(127.29.120.1:34467)] cleaning up while in state READY due to: connection closed
02:12:40.303 [DEBUG - main] (Connection.java:575) [peer master-127.29.120.62:38375(127.29.120.62:38375)] disconnecting while in state READY
02:12:40.304 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.29.120.62:38375(127.29.120.62:38375)] handling channelInactive
02:12:40.304 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.29.120.62:38375(127.29.120.62:38375)] cleaning up while in state READY due to: connection closed
02:12:40.305 [DEBUG - main] (Connection.java:575) [peer master-127.29.120.61:40613(127.29.120.61:40613)] disconnecting while in state READY
02:12:40.306 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.29.120.61:40613(127.29.120.61:40613)] handling channelInactive
02:12:40.306 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.29.120.61:40613(127.29.120.61:40613)] cleaning up while in state READY due to: connection closed
02:12:40.307 [DEBUG - main] (Connection.java:575) [peer master-127.29.120.60:33989(127.29.120.60:33989)] disconnecting while in state TERMINATED
02:12:40.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.307030 31006 raft_consensus.cc:2272] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125 [term 2 FOLLOWER]: Raft consensus is shut down!
02:12:40.308 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:12:40.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.310288 31005 ts_tablet_manager.cc:1929] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
02:12:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.310917 31005 log.cc:1199] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Deleting WAL directory at /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster4593445058620721959/ts-1/wal/wals/ec5f6c96ce644f5eb904ba2da4f80dec
02:12:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.311538 31006 ts_tablet_manager.cc:1916] T ec5f6c96ce644f5eb904ba2da4f80dec P 3d9a394511854f95b0ebe582d92f4125: Deleting tablet data with delete state TABLET_DATA_DELETED
02:12:40.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.311972 31005 ts_tablet_manager.cc:1950] T ec5f6c96ce644f5eb904ba2da4f80dec P 04eca53f279b41b1b5ca0046b4429052: Deleting consensus metadata
02:12:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.315455 30205 catalog_manager.cc:5028] TS 04eca53f279b41b1b5ca0046b4429052 (127.29.120.2:37087): tablet ec5f6c96ce644f5eb904ba2da4f80dec (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=b9f9f67f344c4409a79e484ea58d6cfe]) successfully deleted
02:12:40.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.315925 30176 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 30456
02:12:40.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.345798 30176 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 30613
02:12:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.377007 30176 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 30188
02:12:40.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:40.400703 30176 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 30258
02:12:41.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:41Z chronyd exiting
.02:12:42.853 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783476762853
02:12:42.857 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:12:42.858 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:12:42.858 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task2lK8M4/test-tmp
02:12:42.858 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:12:42.859 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task2lK8M4/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:12:42.861 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:12:43.188 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:43.188 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:12:43.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.192003 31011 mini_oidc.cc:150] Starting JWKS server
02:12:43.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.195231 31011 webserver.cc:533] Webserver started at http://127.0.0.1:42457/ using document root <none> and password file <none>
02:12:43.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.195648 31011 mini_oidc.cc:186] Starting OIDC Discovery server
02:12:43.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.197414 31011 webserver.cc:533] Webserver started at http://127.0.0.1:46847/ using document root <none> and password file <none>
02:12:43.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:43Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:12:43.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:12:43Z Disabled control of system clock
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.259865 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/logs
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data/info.pb
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:43.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.254:38557
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.254
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:43.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json with env {}
02:12:43.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.566067 31023 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:43.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.566634 31023 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:43.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.567090 31023 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:43.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.599840 31023 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:43.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.600126 31023 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:43.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.600332 31023 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:43.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.600540 31023 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:43.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.600840 31023 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:43.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.601016 31023 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42457/jwks.json
02:12:43.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.638353 31023 master_runner.cc:387] Master server non-default flags:
02:12:43.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:43.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:43.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.254:38557
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data/info.pb
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.254
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/logs
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:43.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:43.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.639703 31023 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:43.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:43.641330 31023 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:43.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.651603 31029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:44.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.653264 31030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:44.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:43.656997 31032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:44.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:44.853482 31031 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1195 milliseconds
02:12:44.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.853600 31023 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:44.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.854765 31023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:44.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.857590 31023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:44.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.859025 31023 hybrid_clock.cc:648] HybridClock initialized: now 1783476764858962 us; error 83 us; skew 500 ppm
02:12:44.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.859802 31023 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:44.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.865962 31023 webserver.cc:533] Webserver started at http://127.30.72.254:35247/ using document root <none> and password file <none>
02:12:44.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.866860 31023 fs_manager.cc:362] Metadata directory not provided
02:12:44.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.867057 31023 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:44.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.867439 31023 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:44.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.871694 31023 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data/instance:
02:12:44.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce259de67dc842f383d730693779b017"
02:12:44.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:44 on dist-test-slave-3cc9"
02:12:44.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.872810 31023 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal/instance:
02:12:44.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce259de67dc842f383d730693779b017"
02:12:44.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:44 on dist-test-slave-3cc9"
02:12:44.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.880164 31023 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
02:12:44.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.885850 31039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:44.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.887253 31023 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
02:12:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.887699 31023 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal
02:12:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ce259de67dc842f383d730693779b017"
02:12:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:44 on dist-test-slave-3cc9"
02:12:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.888154 31023 fs_report.cc:389] FS layout report
02:12:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:44.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data/data
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:44.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:44.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.953365 31023 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:44.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.954830 31023 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:44.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:44.955240 31023 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:45.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.026739 31023 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.254:38557
02:12:45.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.026813 31090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.254:38557 every 8 connection(s)
02:12:45.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.029486 31023 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/data/info.pb
02:12:45.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.033298 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31023
02:12:45.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.033829 31011 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-0/wal/instance
02:12:45.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.036386 31091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.038942 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/logs
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data/info.pb
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:45.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.253:43289
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.253
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:45.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json with env {}
02:12:45.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.050002 31091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } has no permanent_uuid. Determining permanent_uuid...
02:12:45.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.079449 31091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } has no permanent_uuid. Determining permanent_uuid...
02:12:45.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.082286 31043 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:45.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.086558 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:45.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.136049 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 1
02:12:45.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.141291 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:45.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.209714 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 2
02:12:45.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.215287 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:45.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.306720 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 3
02:12:45.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.311556 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.354628 31093 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:45.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.355206 31093 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:45.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.355921 31093 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:45.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.389812 31093 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:45.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.390105 31093 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:45.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.390313 31093 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:45.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.390514 31093 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:45.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.390715 31093 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:45.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.390867 31093 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42457/jwks.json
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.429138 31093 master_runner.cc:387] Master server non-default flags:
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:45.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.253:43289
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data/info.pb
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.253
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/logs
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:45.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:45.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:45.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.430475 31093 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:45.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.432056 31093 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:45.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.443037 31102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:45.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.455021 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 4
02:12:45.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.463352 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:45.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:45.762974 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 5
02:12:45.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.772123 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:46.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.319720 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 6
02:12:46.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.347790 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.253:43289: Network error: Client connection negotiation failed: client connection to 127.30.72.253:43289: connect: Connection refused (error 111)
02:12:46.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.848181 31101 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 31093
02:12:46.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.963776 31093 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.521s	user 0.529s	sys 0.991s
02:12:46.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.964119 31093 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.521s	user 0.529s	sys 0.991s
02:12:46.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:45.443611 31103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:46.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.966315 31093 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:46.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.966465 31104 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1522 milliseconds
02:12:46.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:46.966431 31105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:46.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.970626 31093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:46.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.973187 31093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:46.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.974583 31093 hybrid_clock.cc:648] HybridClock initialized: now 1783476766974552 us; error 36 us; skew 500 ppm
02:12:46.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.975458 31093 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:46.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.981627 31093 webserver.cc:533] Webserver started at http://127.30.72.253:41041/ using document root <none> and password file <none>
02:12:46.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.982627 31093 fs_manager.cc:362] Metadata directory not provided
02:12:46.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.982880 31093 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:46.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.983430 31093 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:46.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.988672 31093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data/instance:
02:12:46.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b638ef232b154349aeceafd26f8be88a"
02:12:46.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:46 on dist-test-slave-3cc9"
02:12:46.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.989987 31093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal/instance:
02:12:46.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b638ef232b154349aeceafd26f8be88a"
02:12:46.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:46 on dist-test-slave-3cc9"
02:12:46.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:46.997452 31093 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.002s
02:12:47.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.003216 31114 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:47.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.004264 31093 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.004642 31093 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b638ef232b154349aeceafd26f8be88a"
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:46 on dist-test-slave-3cc9"
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.005086 31093 fs_report.cc:389] FS layout report
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data/data
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:47.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:47.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.066130 31093 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:47.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.067780 31093 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:47.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.068356 31093 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:47.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.139907 31093 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.253:43289
02:12:47.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.139993 31165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.253:43289 every 8 connection(s)
02:12:47.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.142656 31093 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/data/info.pb
02:12:47.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.145327 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31093
02:12:47.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.145900 31011 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-1/wal/instance
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.149776 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/logs
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/info.pb
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:47.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.252:34629
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.252
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:47.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json with env {}
02:12:47.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.149865 31166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:47.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.161126 31166 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } has no permanent_uuid. Determining permanent_uuid...
02:12:47.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.185428 31166 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } has no permanent_uuid. Determining permanent_uuid...
02:12:47.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.200109 31166 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } has no permanent_uuid. Determining permanent_uuid...
02:12:47.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.202529 31115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.206631 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.256166 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 1
02:12:47.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.260567 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.329030 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 2
02:12:47.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.333732 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.408386 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } attempt: 7
02:12:47.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.420212 31091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } has no permanent_uuid. Determining permanent_uuid...
02:12:47.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.425114 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 3
02:12:47.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.426498 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.429607 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.472533 31168 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.473167 31168 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.473694 31168 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:47.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.484954 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 1
02:12:47.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.489691 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.508062 31168 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:47.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.508441 31168 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:47.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.508843 31168 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:47.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.509194 31168 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:47.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.509524 31168 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:47.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.509778 31168 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42457/jwks.json
02:12:47.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.546486 31168 master_runner.cc:387] Master server non-default flags:
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.252:34629
02:12:47.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/info.pb
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.252
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/logs
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:47.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:47.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:47.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.548271 31168 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:47.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.550139 31168 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:47.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.561839 31180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:47.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.571116 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 2
02:12:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.573077 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 4
02:12:47.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.579309 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.580900 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.664852 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 3
02:12:47.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.673847 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.814412 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 4
02:12:47.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.828092 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:47.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:47.880426 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 5
02:12:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.888587 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:48.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.111652 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 5
02:12:48.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.120410 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:48.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.436165 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 6
02:12:48.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.473232 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:48.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:48.673002 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 6
02:12:48.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.702271 31091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:49.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:48.965583 31179 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 31168
02:12:49.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.391335 31168 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.829s	user 0.637s	sys 1.181s
02:12:49.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.391674 31168 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.830s	user 0.637s	sys 1.181s
02:12:49.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:47.562793 31181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:49.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.394222 31183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.397640 31182 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1835 milliseconds
02:12:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.397650 31168 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:49.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.399068 31168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:49.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.401589 31168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:49.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.402935 31168 hybrid_clock.cc:648] HybridClock initialized: now 1783476769402910 us; error 64 us; skew 500 ppm
02:12:49.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.403692 31168 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:49.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.409911 31168 webserver.cc:533] Webserver started at http://127.30.72.252:41925/ using document root <none> and password file <none>
02:12:49.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.410846 31168 fs_manager.cc:362] Metadata directory not provided
02:12:49.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.411048 31168 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:49.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.411435 31168 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:49.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.415691 31168 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/instance:
02:12:49.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c193153b0b9649b0aa7146a9c00013b6"
02:12:49.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3cc9"
02:12:49.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.416836 31168 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal/instance:
02:12:49.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c193153b0b9649b0aa7146a9c00013b6"
02:12:49.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3cc9"
02:12:49.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.423995 31168 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
02:12:49.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.429857 31194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:49.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.431066 31168 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
02:12:49.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.431373 31168 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:49.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c193153b0b9649b0aa7146a9c00013b6"
02:12:49.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3cc9"
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.431685 31168 fs_report.cc:389] FS layout report
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/data
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:49.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:49.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.506368 31168 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:49.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.507823 31168 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:49.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.508213 31168 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:49.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.533815 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 7
02:12:49.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.541939 31166 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.72.252:34629: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:12:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.585569 31168 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.252:34629
02:12:49.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.585631 31247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.252:34629 every 8 connection(s)
02:12:49.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.588402 31168 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/info.pb
02:12:49.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.591534 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31168
02:12:49.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.592015 31011 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal/instance
02:12:49.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.595301 31248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:49.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.613309 31248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } has no permanent_uuid. Determining permanent_uuid...
02:12:49.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.639714 31248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } has no permanent_uuid. Determining permanent_uuid...
02:12:49.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.650549 31248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } has no permanent_uuid. Determining permanent_uuid...
02:12:49.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.667785 31248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Bootstrap starting.
02:12:49.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.674791 31248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Neither blocks nor log segments found. Creating new log.
02:12:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.676498 31248 log.cc:826] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Log is configured to *not* fsync() on all Append() calls
02:12:49.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.680833 31248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: No bootstrap required, opened a new log
02:12:49.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.699869 31248 raft_consensus.cc:359] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.700497 31248 raft_consensus.cc:385] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:49.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.700871 31248 raft_consensus.cc:740] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c193153b0b9649b0aa7146a9c00013b6, State: Initialized, Role: FOLLOWER
02:12:49.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.701570 31248 consensus_queue.cc:260] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.703814 31257 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:49.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.704416 31257 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: FOLLOWER
02:12:49.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.705695 31248 sys_catalog.cc:565] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: configured and running, proceeding with master startup.
02:12:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.731010 31268 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:12:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.731405 31268 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:12:49.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.735842 31091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 7
02:12:49.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.726670 31168 master_runner.cc:187] Error getting master registration for 127.30.72.254:38557: OK, instance_id { permanent_uuid: "ce259de67dc842f383d730693779b017" instance_seqno: 1783476765007509 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:49.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.752496 31168 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:49.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.758677 31091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: Bootstrap starting.
02:12:49.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.763424 31200 tablet.cc:2406] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:49.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.764834 31091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: Neither blocks nor log segments found. Creating new log.
02:12:49.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.766637 31091 log.cc:826] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: Log is configured to *not* fsync() on all Append() calls
02:12:49.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.771713 31091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: No bootstrap required, opened a new log
02:12:49.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.788163 31257 raft_consensus.cc:493] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.788796 31257 raft_consensus.cc:515] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.792589 31091 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.793792 31091 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.794272 31091 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce259de67dc842f383d730693779b017, State: Initialized, Role: FOLLOWER
02:12:49.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.795537 31091 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.796386 31257 leader_election.cc:290] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce259de67dc842f383d730693779b017 (127.30.72.254:38557), b638ef232b154349aeceafd26f8be88a (127.30.72.253:43289)
02:12:49.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.799326 31272 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:49.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.800138 31272 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: This master's current role is: FOLLOWER
02:12:49.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.801347 31091 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: configured and running, proceeding with master startup.
02:12:49.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.801488 31066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c193153b0b9649b0aa7146a9c00013b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce259de67dc842f383d730693779b017" is_pre_election: true
02:12:49.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.802340 31066 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c193153b0b9649b0aa7146a9c00013b6 in term 0.
02:12:49.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.803941 31196 leader_election.cc:304] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c193153b0b9649b0aa7146a9c00013b6, ce259de67dc842f383d730693779b017; no voters: 
02:12:49.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.805287 31257 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:49.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.806015 31257 raft_consensus.cc:493] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:49.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.806383 31257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 0 FOLLOWER]: Advancing to term 1
02:12:49.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.815681 31257 raft_consensus.cc:515] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.825064 31066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c193153b0b9649b0aa7146a9c00013b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce259de67dc842f383d730693779b017"
02:12:49.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.825812 31066 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 0 FOLLOWER]: Advancing to term 1
02:12:49.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.826781 31257 leader_election.cc:290] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [CANDIDATE]: Term 1 election: Requested vote from peers ce259de67dc842f383d730693779b017 (127.30.72.254:38557), b638ef232b154349aeceafd26f8be88a (127.30.72.253:43289)
02:12:49.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.833881 31066 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c193153b0b9649b0aa7146a9c00013b6 in term 1.
02:12:49.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.835086 31196 leader_election.cc:304] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c193153b0b9649b0aa7146a9c00013b6, ce259de67dc842f383d730693779b017; no voters: 
02:12:49.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.836045 31257 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 1 FOLLOWER]: Leader election won for term 1
02:12:49.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.838546 31257 raft_consensus.cc:697] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 1 LEADER]: Becoming Leader. State: Replica: c193153b0b9649b0aa7146a9c00013b6, State: Running, Role: LEADER
02:12:49.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.839836 31257 consensus_queue.cc:237] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:49.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.861091 31277 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c193153b0b9649b0aa7146a9c00013b6. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:49.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.861966 31277 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: LEADER
02:12:49.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.873353 31283 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:12:49.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.881306 31283 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:12:49.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.908095 31286 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:12:49.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.908867 31286 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:12:49.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.916141 31066 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Refusing update from remote peer c193153b0b9649b0aa7146a9c00013b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:49.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.918403 31277 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:12:49.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.897553 31023 master_runner.cc:187] Error getting master registration for 127.30.72.253:43289: OK, instance_id { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" instance_seqno: 1783476767121169 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:12:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.947675 31023 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:12:49.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:49.965845 31045 tablet.cc:2406] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:49.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.977203 31272 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c193153b0b9649b0aa7146a9c00013b6. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:49.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.977932 31272 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: This master's current role is: FOLLOWER
02:12:49.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.978888 31288 mvcc.cc:204] Tried to move back new op lower bound from 7305120849554063360 to 7305120849304489984. Current Snapshot: MvccSnapshot[applied={T|T < 7305120849554063360}]
02:12:49.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.981001 31277 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:49.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.981699 31277 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: LEADER
02:12:49.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.985419 31289 mvcc.cc:204] Tried to move back new op lower bound from 7305120849554063360 to 7305120849304489984. Current Snapshot: MvccSnapshot[applied={T|T < 7305120849554063360}]
02:12:49.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.989341 31283 catalog_manager.cc:1383] Generated new cluster ID: 65a52a28e5c8467d9872502c3cad1238
02:12:49.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.989689 31283 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:12:49.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.996450 31272 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:49.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:49.997129 31272 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: This master's current role is: FOLLOWER
02:12:50.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.047715 31283 catalog_manager.cc:1406] Generated new certificate authority record
02:12:50.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.049945 31283 catalog_manager.cc:1540] Loading token signing keys...
02:12:50.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.080842 31283 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Generated new TSK 0
02:12:50.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.082343 31283 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.121500 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/logs
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data/info.pb
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.193:0
02:12:50.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.72.193
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.193
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.681984 31293 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.682665 31293 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.683669 31293 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:50.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.749769 31293 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:50.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.751684 31293 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.72.193
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.825044 31293 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data
02:12:50.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.193:0
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data/info.pb
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.193
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.72.193
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/logs
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:50.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:50.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:50.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:50.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:50.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.828608 31293 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:50.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.831074 31293 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:50.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.868149 31301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:50.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.915396 31286 catalog_manager.cc:1295] Loaded cluster ID: 65a52a28e5c8467d9872502c3cad1238
02:12:50.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.916049 31286 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: loading cluster ID for follower catalog manager: success
02:12:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.923919 31286 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: acquiring CA information for follower catalog manager: success
02:12:50.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:50.942561 31286 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:51.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.502534 31198 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.30.72.253:43289 timed out after 1.675s (SENT)
02:12:51.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.632457 31166 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } attempt: 8
02:12:51.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.689251 31166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: Bootstrap starting.
02:12:51.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.697376 31166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: Neither blocks nor log segments found. Creating new log.
02:12:51.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.711150 31166 log.cc:826] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: Log is configured to *not* fsync() on all Append() calls
02:12:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.730141 31166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: No bootstrap required, opened a new log
02:12:51.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.779042 31166 raft_consensus.cc:359] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:51.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.792901 31166 raft_consensus.cc:385] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:51.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.793978 31166 raft_consensus.cc:740] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b638ef232b154349aeceafd26f8be88a, State: Initialized, Role: FOLLOWER
02:12:51.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.795398 31166 consensus_queue.cc:260] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:12:51.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.806011 31311 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:51.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.810240 31311 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: This master's current role is: FOLLOWER
02:12:51.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.809856 31166 sys_catalog.cc:565] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: configured and running, proceeding with master startup.
02:12:51.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.811218 31140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c193153b0b9649b0aa7146a9c00013b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b638ef232b154349aeceafd26f8be88a"
02:12:51.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.812564 31140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58326 (request call id 2) took 1986 ms (client timeout 1675 ms). Trace:
02:12:51.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.813063 31140 rpcz_store.cc:269] 0708 02:12:49.826013 (+     0us) service_pool.cc:167] Inserting onto call queue
02:12:51.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:49.826184 (+   171us) service_pool.cc:224] Handling call
02:12:51.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:51.812471 (+1986287us) inbound_call.cc:177] Queueing success response
02:12:51.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:12:51.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.814519 31138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c193153b0b9649b0aa7146a9c00013b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b638ef232b154349aeceafd26f8be88a"
02:12:51.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.816457 31141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c193153b0b9649b0aa7146a9c00013b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b638ef232b154349aeceafd26f8be88a" is_pre_election: true
02:12:51.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.817518 31141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58326 (request call id 1) took 2021 ms (client timeout 2055 ms). Trace:
02:12:51.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.817941 31141 rpcz_store.cc:269] 0708 02:12:49.796642 (+     0us) service_pool.cc:167] Inserting onto call queue
02:12:51.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:49.796808 (+   166us) service_pool.cc:224] Handling call
02:12:51.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:51.817448 (+2020640us) inbound_call.cc:177] Queueing success response
02:12:51.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:12:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.810560 31139 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 0 FOLLOWER]: Advancing to term 1
02:12:51.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:51.831753 31120 tablet.cc:2406] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:51.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.838019 31139 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 1 FOLLOWER]: Refusing update from remote peer c193153b0b9649b0aa7146a9c00013b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:51.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.838924 31139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58326 (request call id 3) took 1925 ms. Trace:
02:12:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.839365 31139 rpcz_store.cc:276] 0708 02:12:49.913726 (+     0us) service_pool.cc:167] Inserting onto call queue
02:12:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:49.913928 (+   202us) service_pool.cc:224] Handling call
02:12:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:51.810195 (+1896267us) raft_consensus.cc:1471] Updating replica for 0 ops
02:12:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:51.838485 (+ 28290us) raft_consensus.cc:1697] Filling consensus response to leader.
02:12:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 02:12:51.838845 (+   360us) inbound_call.cc:177] Queueing success response
02:12:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:12:51.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.841364 31294 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:12:51.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.917846 31311 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c193153b0b9649b0aa7146a9c00013b6. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:51.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.918771 31311 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: This master's current role is: FOLLOWER
02:12:51.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.919024 31322 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:51.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.919800 31322 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: This master's current role is: FOLLOWER
02:12:51.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:51.934223 31328 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:12:52.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.245993 31294 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c193153b0b9649b0aa7146a9c00013b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:12:52.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.247090 31294 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: LEADER
02:12:52.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.962060 31328 catalog_manager.cc:1295] Loaded cluster ID: 65a52a28e5c8467d9872502c3cad1238
02:12:52.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.968613 31328 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: loading cluster ID for follower catalog manager: success
02:12:52.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:52.995199 31328 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: acquiring CA information for follower catalog manager: success
02:12:53.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.011492 31328 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:12:53.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:50.876209 31302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:53.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:53.474004 31293 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.596s	user 0.469s	sys 0.945s
02:12:53.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:53.474388 31293 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.597s	user 0.469s	sys 0.945s
02:12:53.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:52.254908 31300 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31293
02:12:53.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:53.476377 31305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:53.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:53.480180 31303 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2604 milliseconds
02:12:53.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.480281 31293 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:53.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.481802 31293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:53.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.484417 31293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:53.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.485855 31293 hybrid_clock.cc:648] HybridClock initialized: now 1783476773485716 us; error 142 us; skew 500 ppm
02:12:53.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.486923 31293 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:53.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.494500 31293 webserver.cc:533] Webserver started at http://127.30.72.193:41015/ using document root <none> and password file <none>
02:12:53.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.495787 31293 fs_manager.cc:362] Metadata directory not provided
02:12:53.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.496080 31293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:53.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.496630 31293 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:53.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.503017 31293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data/instance:
02:12:53.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0d84a035dc24b7f80d1053def8dc210"
02:12:53.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:53 on dist-test-slave-3cc9"
02:12:53.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.504528 31293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal/instance:
02:12:53.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0d84a035dc24b7f80d1053def8dc210"
02:12:53.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:53 on dist-test-slave-3cc9"
02:12:53.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.513437 31293 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
02:12:53.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.519435 31338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:53.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.520713 31293 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
02:12:53.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.521108 31293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal
02:12:53.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0d84a035dc24b7f80d1053def8dc210"
02:12:53.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:53 on dist-test-slave-3cc9"
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.521492 31293 fs_report.cc:389] FS layout report
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data/data
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:53.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:53.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.580487 31293 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.582127 31293 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:53.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.582667 31293 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:53.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.586117 31293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:53.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.591637 31293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:53.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.591900 31293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:53.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.592195 31293 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:53.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.592403 31293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.768788 31293 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.193:43537
02:12:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.768889 31451 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.193:43537 every 8 connection(s)
02:12:53.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.771827 31293 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/data/info.pb
02:12:53.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.774574 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31293
02:12:53.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.775187 31011 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-0/wal/instance
02:12:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.791107 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/logs
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data/info.pb
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:53.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.194:0
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.72.194
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.194
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:53.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:53.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.832051 31452 heartbeater.cc:344] Connected to a master server at 127.30.72.252:34629
02:12:53.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.832767 31452 heartbeater.cc:461] Registering TS with master...
02:12:53.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.834543 31452 heartbeater.cc:507] Master 127.30.72.252:34629 requested a full tablet report, sending...
02:12:53.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.838196 31212 ts_manager.cc:194] Registered new tserver with Master: a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537)
02:12:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.841426 31212 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.72.193:37411
02:12:53.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.849750 31457 heartbeater.cc:344] Connected to a master server at 127.30.72.254:38557
02:12:53.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.850184 31457 heartbeater.cc:461] Registering TS with master...
02:12:53.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.850864 31457 heartbeater.cc:507] Master 127.30.72.254:38557 requested a full tablet report, sending...
02:12:53.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.854224 31056 ts_manager.cc:194] Registered new tserver with Master: a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537)
02:12:53.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.858436 31453 heartbeater.cc:344] Connected to a master server at 127.30.72.253:43289
02:12:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.858779 31453 heartbeater.cc:461] Registering TS with master...
02:12:53.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.859431 31453 heartbeater.cc:507] Master 127.30.72.253:43289 requested a full tablet report, sending...
02:12:53.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:53.864594 31131 ts_manager.cc:194] Registered new tserver with Master: a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537)
02:12:54.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.173300 31456 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:54.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.173955 31456 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:54.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.174642 31456 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:54.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.211202 31456 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:54.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.212057 31456 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.72.194
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.249187 31456 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data
02:12:54.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.194:0
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data/info.pb
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.194
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.72.194
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/logs
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:54.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.250725 31456 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:54.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.252243 31456 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:54.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.264858 31468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:54.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:54.845953 31452 heartbeater.cc:499] Master 127.30.72.252:34629 was elected leader, sending a full tablet report...
02:12:56.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:55.668066 31467 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31456
02:12:56.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.022495 31456 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.756s	user 0.589s	sys 1.043s
02:12:56.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.022843 31456 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.757s	user 0.589s	sys 1.043s
02:12:56.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:54.266343 31469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:56.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.024519 31470 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1757 milliseconds
02:12:56.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.025422 31456 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:12:56.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.025454 31471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:56.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.032075 31456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:56.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.034759 31456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:56.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.037282 31456 hybrid_clock.cc:648] HybridClock initialized: now 1783476776037221 us; error 60 us; skew 500 ppm
02:12:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.038355 31456 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:56.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.046077 31456 webserver.cc:533] Webserver started at http://127.30.72.194:45705/ using document root <none> and password file <none>
02:12:56.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.047300 31456 fs_manager.cc:362] Metadata directory not provided
02:12:56.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.047576 31456 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:56.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.048108 31456 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:56.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.058243 31456 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data/instance:
02:12:56.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "faa67f25f32e4f58a757a1029f321743"
02:12:56.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:56 on dist-test-slave-3cc9"
02:12:56.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.059480 31456 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal/instance:
02:12:56.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "faa67f25f32e4f58a757a1029f321743"
02:12:56.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:56 on dist-test-slave-3cc9"
02:12:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.067185 31456 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.003s
02:12:56.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.073486 31480 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:56.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.074710 31456 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.075002 31456 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "faa67f25f32e4f58a757a1029f321743"
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:56 on dist-test-slave-3cc9"
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.075301 31456 fs_report.cc:389] FS layout report
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data/data
02:12:56.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:56.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:56.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.131801 31456 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:56.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.133358 31456 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:56.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.133765 31456 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:56.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.136940 31456 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:56.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.144722 31456 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:56.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.145376 31456 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
02:12:56.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.145972 31456 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:56.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.146335 31456 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:56.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.306069 31456 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.194:46559
02:12:56.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.306181 31592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.194:46559 every 8 connection(s)
02:12:56.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.308904 31456 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/data/info.pb
02:12:56.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.309538 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31456
02:12:56.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.309993 31011 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal/instance
02:12:56.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.327446 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/logs
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data/info.pb
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.195:0
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.72.195
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.195
02:12:56.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:56.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:56.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:56.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:56.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:56.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:12:56.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.365211 31593 heartbeater.cc:344] Connected to a master server at 127.30.72.252:34629
02:12:56.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.365756 31593 heartbeater.cc:461] Registering TS with master...
02:12:56.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.367137 31593 heartbeater.cc:507] Master 127.30.72.252:34629 requested a full tablet report, sending...
02:12:56.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.370154 31212 ts_manager.cc:194] Registered new tserver with Master: faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:12:56.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.372000 31212 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.72.194:57485
02:12:56.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.376506 31594 heartbeater.cc:344] Connected to a master server at 127.30.72.253:43289
02:12:56.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.376929 31594 heartbeater.cc:461] Registering TS with master...
02:12:56.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.377671 31594 heartbeater.cc:507] Master 127.30.72.253:43289 requested a full tablet report, sending...
02:12:56.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.378000 31597 heartbeater.cc:344] Connected to a master server at 127.30.72.254:38557
02:12:56.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.378415 31597 heartbeater.cc:461] Registering TS with master...
02:12:56.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.379017 31597 heartbeater.cc:507] Master 127.30.72.254:38557 requested a full tablet report, sending...
02:12:56.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.381253 31131 ts_manager.cc:194] Registered new tserver with Master: faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:12:56.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.381582 31056 ts_manager.cc:194] Registered new tserver with Master: faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:12:56.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.678692 31603 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:56.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.679275 31603 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:56.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.679900 31603 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:56.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.712530 31603 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:56.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.713668 31603 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.72.195
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.750905 31603 tablet_server_runner.cc:78] Tablet server non-default flags:
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.195:0
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data/info.pb
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.195
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.72.195
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/logs
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.752638 31603 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:56.754415 31603 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:56.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.772310 31609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:57.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:57.376689 31593 heartbeater.cc:499] Master 127.30.72.252:34629 was elected leader, sending a full tablet report...
02:12:58.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:56.772850 31610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:58.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.099068 31603 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.328s	user 0.515s	sys 0.812s
02:12:58.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.099466 31603 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.329s	user 0.515s	sys 0.812s
02:12:58.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.102989 31603 server_base.cc:1061] running on GCE node
02:12:58.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.104574 31615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:12:58.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.106266 31603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:12:58.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.109166 31603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:12:58.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.110868 31603 hybrid_clock.cc:648] HybridClock initialized: now 1783476778110810 us; error 41 us; skew 500 ppm
02:12:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.112099 31603 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:12:58.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.121421 31603 webserver.cc:533] Webserver started at http://127.30.72.195:39879/ using document root <none> and password file <none>
02:12:58.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.122823 31603 fs_manager.cc:362] Metadata directory not provided
02:12:58.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.123162 31603 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:12:58.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.124017 31603 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:12:58.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.131311 31603 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data/instance:
02:12:58.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20101acdac3c441dafd6bffef696b832"
02:12:58.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:58 on dist-test-slave-3cc9"
02:12:58.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.133078 31603 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal/instance:
02:12:58.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20101acdac3c441dafd6bffef696b832"
02:12:58.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:58 on dist-test-slave-3cc9"
02:12:58.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.144120 31603 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.005s
02:12:58.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.152415 31620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:12:58.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.153853 31603 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
02:12:58.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.154305 31603 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal
02:12:58.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20101acdac3c441dafd6bffef696b832"
02:12:58.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:58 on dist-test-slave-3cc9"
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.154788 31603 fs_report.cc:389] FS layout report
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data/data
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:12:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:12:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:12:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:12:58.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.241523 31603 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:12:58.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.243139 31603 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:12:58.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.243542 31603 kserver.cc:163] Server-wide thread pool size limit: 3276
02:12:58.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.246186 31603 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:12:58.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.250540 31603 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:12:58.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.250741 31603 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:12:58.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.250939 31603 ts_tablet_manager.cc:616] Registered 0 tablets
02:12:58.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.251075 31603 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:12:58.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.394428 31603 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.195:40401
02:12:58.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.394537 31732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.195:40401 every 8 connection(s)
02:12:58.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.396914 31603 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/data/info.pb
02:12:58.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.400568 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31603
02:12:58.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.401134 31011 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal/instance
02:12:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.453953 31734 heartbeater.cc:344] Connected to a master server at 127.30.72.253:43289
02:12:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.454432 31734 heartbeater.cc:461] Registering TS with master...
02:12:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.455322 31735 heartbeater.cc:344] Connected to a master server at 127.30.72.254:38557
02:12:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.455677 31735 heartbeater.cc:461] Registering TS with master...
02:12:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.455803 31733 heartbeater.cc:344] Connected to a master server at 127.30.72.252:34629
02:12:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.455849 31734 heartbeater.cc:507] Master 127.30.72.253:43289 requested a full tablet report, sending...
02:12:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.456207 31733 heartbeater.cc:461] Registering TS with master...
02:12:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.456899 31735 heartbeater.cc:507] Master 127.30.72.254:38557 requested a full tablet report, sending...
02:12:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.457130 31733 heartbeater.cc:507] Master 127.30.72.252:34629 requested a full tablet report, sending...
02:12:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.459043 31131 ts_manager.cc:194] Registered new tserver with Master: 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401)
02:12:58.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.459292 31212 ts_manager.cc:194] Registered new tserver with Master: 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401)
02:12:58.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.459400 31056 ts_manager.cc:194] Registered new tserver with Master: 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401)
02:12:58.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.461092 31212 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.72.195:41251
02:12:58.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.473842 31011 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:12:58.485 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:12:58.485 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:12:58.488 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.72.254"
      port: 38557
    }
    bound_http_address {
      host: "127.30.72.254"
      port: 35247
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.72.253"
      port: 43289
    }
    bound_http_address {
      host: "127.30.72.253"
      port: 41041
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.72.252"
      port: 34629
    }
    bound_http_address {
      host: "127.30.72.252"
      port: 41925
    }
  }
}

02:12:58.488 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:12:58.489 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.72.193"
      port: 43537
    }
    bound_http_address {
      host: "127.30.72.193"
      port: 41015
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.72.194"
      port: 46559
    }
    bound_http_address {
      host: "127.30.72.194"
      port: 45705
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.72.195"
      port: 40401
    }
    bound_http_address {
      host: "127.30.72.195"
      port: 39879
    }
  }
}

02:12:58.489 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:12:58.493 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:12:58.495 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.72.254:38557(127.30.72.254:38557)] connecting to peer
02:12:58.496 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.72.253:43289(127.30.72.253:43289)] connecting to peer
02:12:58.497 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.72.254:38557(127.30.72.254:38557)] Successfully connected to peer
02:12:58.499 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.72.252:34629(127.30.72.252:34629)] connecting to peer
02:12:58.501 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.72.254
02:12:58.501 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.72.252:34629(127.30.72.252:34629)] Successfully connected to peer
02:12:58.503 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.72.253:43289(127.30.72.253:43289)] Successfully connected to peer
02:12:58.505 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.72.252
02:12:58.507 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.72.253
02:12:58.525 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x4659097d, L:/127.0.0.1:53592 - R:/127.30.72.254:38557] using SASL/PLAIN
02:12:58.527 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x1ee99699, L:/127.0.0.1:33018 - R:/127.30.72.253:43289] using SASL/PLAIN
02:12:58.534 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xd42845bc, L:/127.0.0.1:39146 - R:/127.30.72.252:34629] using SASL/PLAIN
02:12:58.538 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:12:58.539 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=44), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [38ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [40ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: OK, deferred=null) after lookup
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.541149 31212 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39146:
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:12:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:12:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:12:58.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.545248 31212 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:12:58.583 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e94e10cc18064ca4a5f1c10fab987e86
02:12:58.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.644428 31668 tablet_service.cc:1511] Processing CreateTablet for tablet a516028a9cf64745858a1e842b83444b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e94e10cc18064ca4a5f1c10fab987e86]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:58.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.646999 31668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a516028a9cf64745858a1e842b83444b. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:58.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.653095 31387 tablet_service.cc:1511] Processing CreateTablet for tablet a516028a9cf64745858a1e842b83444b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e94e10cc18064ca4a5f1c10fab987e86]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:58.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.655004 31387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a516028a9cf64745858a1e842b83444b. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:58.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.684489 31765 tablet_bootstrap.cc:492] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: Bootstrap starting.
02:12:58.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.685761 31766 tablet_bootstrap.cc:492] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Bootstrap starting.
02:12:58.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.687520 31528 tablet_service.cc:1511] Processing CreateTablet for tablet a516028a9cf64745858a1e842b83444b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e94e10cc18064ca4a5f1c10fab987e86]), partition=RANGE (key) PARTITION UNBOUNDED
02:12:58.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.689060 31528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a516028a9cf64745858a1e842b83444b. 1 dirs total, 0 dirs full, 0 dirs failed
02:12:58.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.692399 31765 tablet_bootstrap.cc:654] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: Neither blocks nor log segments found. Creating new log.
02:12:58.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.693529 31766 tablet_bootstrap.cc:654] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Neither blocks nor log segments found. Creating new log.
02:12:58.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.694921 31765 log.cc:826] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: Log is configured to *not* fsync() on all Append() calls
02:12:58.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.695885 31766 log.cc:826] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Log is configured to *not* fsync() on all Append() calls
02:12:58.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.703774 31765 tablet_bootstrap.cc:492] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: No bootstrap required, opened a new log
02:12:58.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.704295 31765 ts_tablet_manager.cc:1403] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
02:12:58.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.706578 31766 tablet_bootstrap.cc:492] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: No bootstrap required, opened a new log
02:12:58.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.707114 31766 ts_tablet_manager.cc:1403] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
02:12:58.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.714218 31769 tablet_bootstrap.cc:492] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Bootstrap starting.
02:12:58.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.722455 31769 tablet_bootstrap.cc:654] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Neither blocks nor log segments found. Creating new log.
02:12:58.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.724862 31769 log.cc:826] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Log is configured to *not* fsync() on all Append() calls
02:12:58.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.724622 31765 raft_consensus.cc:359] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.725507 31765 raft_consensus.cc:385] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:58.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.725822 31765 raft_consensus.cc:740] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d84a035dc24b7f80d1053def8dc210, State: Initialized, Role: FOLLOWER
02:12:58.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.727444 31765 consensus_queue.cc:260] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.731552 31765 ts_tablet_manager.cc:1434] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: Time spent starting tablet: real 0.027s	user 0.019s	sys 0.009s
02:12:58.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.731755 31769 tablet_bootstrap.cc:492] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: No bootstrap required, opened a new log
02:12:58.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.732270 31769 ts_tablet_manager.cc:1403] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.005s
02:12:58.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.737068 31766 raft_consensus.cc:359] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.738018 31766 raft_consensus.cc:385] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:58.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.738329 31766 raft_consensus.cc:740] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20101acdac3c441dafd6bffef696b832, State: Initialized, Role: FOLLOWER
02:12:58.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.739372 31766 consensus_queue.cc:260] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.750094 31733 heartbeater.cc:499] Master 127.30.72.252:34629 was elected leader, sending a full tablet report...
02:12:58.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.751029 31766 ts_tablet_manager.cc:1434] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Time spent starting tablet: real 0.044s	user 0.025s	sys 0.019s
02:12:58.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.764806 31769 raft_consensus.cc:359] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.765686 31769 raft_consensus.cc:385] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:12:58.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.765975 31769 raft_consensus.cc:740] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa67f25f32e4f58a757a1029f321743, State: Initialized, Role: FOLLOWER
02:12:58.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.766914 31769 consensus_queue.cc:260] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.770538 31769 ts_tablet_manager.cc:1434] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Time spent starting tablet: real 0.038s	user 0.027s	sys 0.009s
02:12:58.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.843143 31460 tablet.cc:2406] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:58.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.850688 31600 tablet.cc:2406] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:58.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.857285 31771 raft_consensus.cc:493] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:12:58.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.857797 31771 raft_consensus.cc:515] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.860255 31771 leader_election.cc:290] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401), faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:12:58.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.872388 31548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "a0d84a035dc24b7f80d1053def8dc210" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faa67f25f32e4f58a757a1029f321743" is_pre_election: true
02:12:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.872360 31688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "a0d84a035dc24b7f80d1053def8dc210" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20101acdac3c441dafd6bffef696b832" is_pre_election: true
02:12:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.873095 31688 raft_consensus.cc:2468] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d84a035dc24b7f80d1053def8dc210 in term 0.
02:12:58.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.873157 31548 raft_consensus.cc:2468] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d84a035dc24b7f80d1053def8dc210 in term 0.
02:12:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.874402 31342 leader_election.cc:304] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20101acdac3c441dafd6bffef696b832, a0d84a035dc24b7f80d1053def8dc210; no voters: 
02:12:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.875145 31771 raft_consensus.cc:2804] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:12:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.875504 31771 raft_consensus.cc:493] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:12:58.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.875833 31771 raft_consensus.cc:3060] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 0 FOLLOWER]: Advancing to term 1
02:12:58.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.880160 31771 raft_consensus.cc:515] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.881785 31771 leader_election.cc:290] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [CANDIDATE]: Term 1 election: Requested vote from peers 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401), faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:12:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.882660 31688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "a0d84a035dc24b7f80d1053def8dc210" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20101acdac3c441dafd6bffef696b832"
02:12:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.882789 31548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "a0d84a035dc24b7f80d1053def8dc210" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faa67f25f32e4f58a757a1029f321743"
02:12:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.883226 31688 raft_consensus.cc:3060] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 0 FOLLOWER]: Advancing to term 1
02:12:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.883291 31548 raft_consensus.cc:3060] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 0 FOLLOWER]: Advancing to term 1
02:12:58.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.890317 31688 raft_consensus.cc:2468] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d84a035dc24b7f80d1053def8dc210 in term 1.
02:12:58.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.890331 31548 raft_consensus.cc:2468] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d84a035dc24b7f80d1053def8dc210 in term 1.
02:12:58.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.891480 31342 leader_election.cc:304] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20101acdac3c441dafd6bffef696b832, a0d84a035dc24b7f80d1053def8dc210; no voters: 
02:12:58.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.892138 31771 raft_consensus.cc:2804] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 1 FOLLOWER]: Leader election won for term 1
02:12:58.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.893841 31771 raft_consensus.cc:697] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [term 1 LEADER]: Becoming Leader. State: Replica: a0d84a035dc24b7f80d1053def8dc210, State: Running, Role: LEADER
02:12:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.894783 31771 consensus_queue.cc:237] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:12:58.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:58.909343 31212 catalog_manager.cc:5697] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193). New cstate: current_term: 1 leader_uuid: "a0d84a035dc24b7f80d1053def8dc210" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } health_report { overall_health: UNKNOWN } } }
02:12:58.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:58.924854 31738 tablet.cc:2406] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:12:59.103 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table e94e10cc18064ca4a5f1c10fab987e86
02:12:59.107 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:12:59.108 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)[L],faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)]}]
02:12:59.108 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [4ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: OK, deferred=null) after lookup
02:12:59.109 [DEBUG - kudu-nio-2] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:12:59.111 [DEBUG - kudu-nio-3] (Connection.java:757) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] Successfully connected to peer
02:12:59.130 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0xf1193d00, L:/127.0.0.1:33050 - R:/127.30.72.193:43537] using TOKEN/null
02:12:59.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.144963 31548 raft_consensus.cc:1275] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Refusing update from remote peer a0d84a035dc24b7f80d1053def8dc210: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:59.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.145304 31688 raft_consensus.cc:1275] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Refusing update from remote peer a0d84a035dc24b7f80d1053def8dc210: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:12:59.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.146991 31776 consensus_queue.cc:1048] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:12:59.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.154356 31771 consensus_queue.cc:1048] T a516028a9cf64745858a1e842b83444b P a0d84a035dc24b7f80d1053def8dc210 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
02:12:59.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.184588 31779 mvcc.cc:204] Tried to move back new op lower bound from 7305120887359471616 to 7305120886361784320. Current Snapshot: MvccSnapshot[applied={T|T < 7305120887359471616}]
02:12:59.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.235121 31781 mvcc.cc:204] Tried to move back new op lower bound from 7305120887359471616 to 7305120886361784320. Current Snapshot: MvccSnapshot[applied={T|T < 7305120887359471616}]
02:12:59.432 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a516028a9cf64745858a1e842b83444b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:12:59.433 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.30.72.252:34629
02:12:59.434 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:12:59.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.434458 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31168
02:12:59.471 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.72.252:34629(127.30.72.252:34629)] handling channelInactive
02:12:59.471 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.72.252:34629(127.30.72.252:34629)] cleaning up while in state READY due to: connection closed
02:12:59.474 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:12:59.474 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.30.72.252:34629
02:12:59.477 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:12:59.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.479417 31011 external_mini_cluster.cc:1372] Running /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:59.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/logs
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/info.pb
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.252:34629
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.252
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=41925
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json with env {}
02:12:59.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.852166 31790 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:12:59.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.852888 31790 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:12:59.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.853560 31790 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:12:59.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.887868 31790 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:12:59.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.888262 31790 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:12:59.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.888674 31790 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:12:59.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.889106 31790 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:12:59.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.889453 31790 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:12:59.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.889711 31790 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42457/jwks.json
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.931032 31790 master_runner.cc:387] Master server non-default flags:
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.72.212:33743
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:12:59.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.72.254:38557,127.30.72.253:43289,127.30.72.252:34629
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.72.252:34629
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42457/jwks.json
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:12:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/info.pb
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.72.252
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=41925
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/logs
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 01:43:34 UTC on e7f111948823
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12767
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:12:59.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.932750 31790 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:12:59.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:12:59.935024 31790 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:12:59.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.946803 31796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:00.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.265270 31733 heartbeater.cc:646] Failed to heartbeat to 127.30.72.252:34629 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:13:00.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.306126 31593 heartbeater.cc:646] Failed to heartbeat to 127.30.72.252:34629 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:13:00.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.310698 31452 heartbeater.cc:646] Failed to heartbeat to 127.30.72.252:34629 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:13:00.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.827044 31806 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c193153b0b9649b0aa7146a9c00013b6)
02:13:00.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.828604 31806 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:13:00.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.834151 31138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce259de67dc842f383d730693779b017" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b638ef232b154349aeceafd26f8be88a" is_pre_election: true
02:13:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.844187 31806 leader_election.cc:290] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b638ef232b154349aeceafd26f8be88a (127.30.72.253:43289), c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629)
02:13:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.854879 31040 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111) [suppressed 13 similar messages]
02:13:00.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.862989 31040 leader_election.cc:336] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629): Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:13:00.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.863550 31040 leader_election.cc:304] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce259de67dc842f383d730693779b017; no voters: b638ef232b154349aeceafd26f8be88a, c193153b0b9649b0aa7146a9c00013b6
02:13:00.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.864467 31806 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:13:00.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.869834 31809 raft_consensus.cc:493] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c193153b0b9649b0aa7146a9c00013b6)
02:13:00.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.871170 31809 raft_consensus.cc:515] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:13:00.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.877238 31066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b638ef232b154349aeceafd26f8be88a" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ce259de67dc842f383d730693779b017" is_pre_election: true
02:13:00.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.878324 31066 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b638ef232b154349aeceafd26f8be88a in term 1.
02:13:00.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.880672 31116 leader_election.cc:304] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b638ef232b154349aeceafd26f8be88a, ce259de67dc842f383d730693779b017; no voters: 
02:13:00.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.897030 31809 leader_election.cc:290] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce259de67dc842f383d730693779b017 (127.30.72.254:38557), c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629)
02:13:00.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.899616 31809 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 1 FOLLOWER]: Leader pre-election won for term 2
02:13:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.902076 31809 raft_consensus.cc:493] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c193153b0b9649b0aa7146a9c00013b6)
02:13:00.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.903939 31809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 1 FOLLOWER]: Advancing to term 2
02:13:00.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.913030 31115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111) [suppressed 7 similar messages]
02:13:00.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.928757 31115 leader_election.cc:336] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629): Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:13:00.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.932004 31809 raft_consensus.cc:515] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:13:00.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.936255 31066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b638ef232b154349aeceafd26f8be88a" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ce259de67dc842f383d730693779b017"
02:13:00.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.937062 31066 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 1 FOLLOWER]: Advancing to term 2
02:13:00.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.949702 31066 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b638ef232b154349aeceafd26f8be88a in term 2.
02:13:00.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:00.958305 31115 leader_election.cc:336] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629): Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111)
02:13:00.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.959527 31809 leader_election.cc:290] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [CANDIDATE]: Term 2 election: Requested vote from peers ce259de67dc842f383d730693779b017 (127.30.72.254:38557), c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629)
02:13:00.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.965086 31116 leader_election.cc:304] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b638ef232b154349aeceafd26f8be88a, ce259de67dc842f383d730693779b017; no voters: c193153b0b9649b0aa7146a9c00013b6
02:13:00.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.966877 31809 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 2 FOLLOWER]: Leader election won for term 2
02:13:00.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.968065 31809 raft_consensus.cc:697] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [term 2 LEADER]: Becoming Leader. State: Replica: b638ef232b154349aeceafd26f8be88a, State: Running, Role: LEADER
02:13:00.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.969673 31809 consensus_queue.cc:237] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:13:00.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.985190 31810 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b638ef232b154349aeceafd26f8be88a. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:00.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.986383 31810 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: This master's current role is: LEADER
02:13:00.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:00.997506 31814 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:13:01.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.011699 31814 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e94e10cc18064ca4a5f1c10fab987e86]
02:13:01.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.022092 31814 tablet_loader.cc:96] loaded metadata for tablet a516028a9cf64745858a1e842b83444b (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e94e10cc18064ca4a5f1c10fab987e86])
02:13:01.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.024714 31814 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:13:01.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.031600 31814 catalog_manager.cc:1295] Loaded cluster ID: 65a52a28e5c8467d9872502c3cad1238
02:13:01.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.032418 31814 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:13:01.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.039844 31814 catalog_manager.cc:1540] Loading token signing keys...
02:13:01.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.046610 31814 catalog_manager.cc:6081] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: Loaded TSK: 0
02:13:01.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.048955 31814 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:13:01.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:01.443746 31115 consensus_peers.cc:597] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a -> Peer c193153b0b9649b0aa7146a9c00013b6 (127.30.72.252:34629): Couldn't send request to peer c193153b0b9649b0aa7146a9c00013b6. Status: Network error: Client connection negotiation failed: client connection to 127.30.72.252:34629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:13:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.951364 31799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:01.520749 31798 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1571 milliseconds
02:13:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.520823 31790 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:13:01.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:12:59.948709 31797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:13:01.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.527035 31790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:13:01.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.530388 31790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:13:01.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.531929 31790 hybrid_clock.cc:648] HybridClock initialized: now 1783476781531840 us; error 94 us; skew 500 ppm
02:13:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.533010 31790 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:13:01.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.540416 31790 webserver.cc:533] Webserver started at http://127.30.72.252:41925/ using document root <none> and password file <none>
02:13:01.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.542069 31790 fs_manager.cc:362] Metadata directory not provided
02:13:01.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.542414 31790 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:13:01.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.555843 31066 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [term 2 FOLLOWER]: Refusing update from remote peer b638ef232b154349aeceafd26f8be88a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:13:01.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.557508 31810 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
02:13:01.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.562418 31790 fs_manager.cc:714] Time spent opening directory manager: real 0.008s	user 0.008s	sys 0.000s
02:13:01.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.563715 31822 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b638ef232b154349aeceafd26f8be88a. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:01.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.564466 31822 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: This master's current role is: FOLLOWER
02:13:01.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.574558 31826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:13:01.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.577189 31790 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.001s	sys 0.007s
02:13:01.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.577399 31822 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:01.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.578604 31822 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce259de67dc842f383d730693779b017 [sys.catalog]: This master's current role is: FOLLOWER
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.577838 31790 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data,/tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c193153b0b9649b0aa7146a9c00013b6"
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 02:12:49 on dist-test-slave-3cc9"
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.580648 31790 fs_report.cc:389] FS layout report
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/wal
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/data
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:13:01.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:13:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:13:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:13:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:13:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:13:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:13:01.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:13:01.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.586397 31810 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:01.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.586989 31810 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: This master's current role is: LEADER
02:13:01.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.657728 31790 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:13:01.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.659170 31790 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:13:01.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.659723 31790 kserver.cc:163] Server-wide thread pool size limit: 3276
02:13:01.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.753073 31790 rpc_server.cc:307] RPC server started. Bound to: 127.30.72.252:34629
02:13:01.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.753139 31879 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.72.252:34629 every 8 connection(s)
02:13:01.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.755962 31790 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/master-2/data/info.pb
02:13:01.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.757177 31011 external_mini_cluster.cc:1434] Started /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu as pid 31790
02:13:01.758 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:13:01.758 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.30.72.193:43537
02:13:01.759 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

02:13:01.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.759565 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31293
02:13:01.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.771733 31880 sys_catalog.cc:263] Verifying existing consensus state
02:13:01.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.779417 31880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Bootstrap starting.
02:13:01.797 [DEBUG - kudu-nio-3] (Connection.java:239) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] handling channelInactive
02:13:01.798 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:13:01.798 [DEBUG - kudu-nio-3] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state READY due to: connection closed
02:13:01.799 [DEBUG - Time-limited test] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:13:01.801 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.801 [DEBUG - kudu-nio-4] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state CONNECTING due to: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.802 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537) for tablet a516028a9cf64745858a1e842b83444b: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.816 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.30.72.252:34629(127.30.72.252:34629)] connecting to peer
02:13:01.819 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.30.72.252:34629(127.30.72.252:34629)] Successfully connected to peer
02:13:01.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.829762 31880 log.cc:826] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Log is configured to *not* fsync() on all Append() calls
02:13:01.833 [DEBUG - kudu-nio-5] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.72.252
02:13:01.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.857301 31880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
02:13:01.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.858366 31880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: Bootstrap complete.
02:13:01.863 [DEBUG - kudu-nio-5] (Negotiator.java:918) Authenticated connection [id: 0x9e84338f, L:/127.0.0.1:38508 - R:/127.30.72.252:34629] using SASL/PLAIN
02:13:01.874 [DEBUG - kudu-nio-5] (RemoteTablet.java:167) master-127.30.72.252:34629 was demoted as the leader for Kudu Master
02:13:01.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.883010 31880 raft_consensus.cc:359] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:13:01.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.886480 31880 raft_consensus.cc:740] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c193153b0b9649b0aa7146a9c00013b6, State: Initialized, Role: FOLLOWER
02:13:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.887567 31880 consensus_queue.cc:260] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } }
02:13:01.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.893549 31887 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:01.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.894349 31887 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: FOLLOWER
02:13:01.898 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.72.252:34629: Catalog manager is not initialized. State: Starting
02:13:01.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.896147 31880 sys_catalog.cc:565] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: configured and running, proceeding with master startup.
02:13:01.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.900221 31855 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [term 1 FOLLOWER]: Advancing to term 2
02:13:01.902 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:13:01.902 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29984, elapsed=86), Traces: [0ms] sending RPC to server master-127.30.72.252:34629, [59ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [59ms] received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [78ms] refreshing cache from master, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [79ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [82ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@722955641(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
02:13:01.911 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:13:01.911 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)[L],faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)]}]
02:13:01.912 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a516028a9cf64745858a1e842b83444b, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=113), Traces: [0ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [4ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [4ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [17ms] refreshing cache from master, [18ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [77ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [96ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [105ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [112ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@443950615(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@5bd44090 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b389236 -> wakeup thread Time-limited test)) after lookup
02:13:01.916 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:13:01.920 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.920 [DEBUG - kudu-nio-6] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state CONNECTING due to: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.920 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537) for tablet a516028a9cf64745858a1e842b83444b: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.931744 31896 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:01.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.932861 31896 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: FOLLOWER
02:13:01.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.936046 31887 sys_catalog.cc:455] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b638ef232b154349aeceafd26f8be88a. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:01.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.936913 31887 sys_catalog.cc:458] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6 [sys.catalog]: This master's current role is: FOLLOWER
02:13:01.940 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:13:01.941 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)[L],faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)]}]
02:13:01.941 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a516028a9cf64745858a1e842b83444b, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=142), Traces: [0ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [4ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [4ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [17ms] refreshing cache from master, [18ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [77ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [96ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [105ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [112ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [118ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [122ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [122ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [137ms] refreshing cache from master, [137ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [142ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@443950615(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@5bd44090 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b389236 -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023))) after lookup
02:13:01.942 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:13:01.948 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.948 [DEBUG - kudu-nio-7] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state CONNECTING due to: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.949 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537) for tablet a516028a9cf64745858a1e842b83444b: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:01.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.956755 31902 catalog_manager.cc:1295] Loaded cluster ID: 65a52a28e5c8467d9872502c3cad1238
02:13:01.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.957271 31902 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: loading cluster ID for follower catalog manager: success
02:13:01.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.965404 31902 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: acquiring CA information for follower catalog manager: success
02:13:01.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:01.975874 31902 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c193153b0b9649b0aa7146a9c00013b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:13:02.000 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:13:02.001 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)[L],faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)]}]
02:13:02.001 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a516028a9cf64745858a1e842b83444b, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=202), Traces: [0ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [4ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [4ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [17ms] refreshing cache from master, [18ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [77ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [96ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [105ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [112ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [118ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [122ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [122ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [137ms] refreshing cache from master, [137ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [142ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [144ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [151ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [151ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [197ms] refreshing cache from master, [197ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [202ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@443950615(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@5bd44090 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b389236 -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733))) after lookup
02:13:02.004 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:13:02.005 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.006 [DEBUG - kudu-nio-0] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state CONNECTING due to: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.006 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537) for tablet a516028a9cf64745858a1e842b83444b: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.062 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:13:02.063 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)[L],faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)]}]
02:13:02.064 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a516028a9cf64745858a1e842b83444b, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=265), Traces: [0ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [4ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [4ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [17ms] refreshing cache from master, [18ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [77ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [96ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [105ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [112ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [118ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [122ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [122ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [137ms] refreshing cache from master, [137ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [142ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [144ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [151ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [151ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [197ms] refreshing cache from master, [197ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [202ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [205ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [208ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [208ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [257ms] refreshing cache from master, [257ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [263ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@443950615(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@5bd44090 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733) -> (continuation of Deferred@178662517 after retry RPC@1727806133), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b389236 -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733) -> (continuation of Deferred@178662517 after retry RPC@1727806133))) after lookup
02:13:02.065 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:13:02.066 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.067 [DEBUG - kudu-nio-1] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state CONNECTING due to: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.067 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537) for tablet a516028a9cf64745858a1e842b83444b: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.252454 31734 heartbeater.cc:499] Master 127.30.72.253:43289 was elected leader, sending a full tablet report...
02:13:02.260 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:13:02.260 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)[L],faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)]}]
02:13:02.261 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a516028a9cf64745858a1e842b83444b, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=462), Traces: [0ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [4ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [4ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [17ms] refreshing cache from master, [18ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [77ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [96ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [105ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [112ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [118ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [122ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [122ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [137ms] refreshing cache from master, [137ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [142ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [144ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [151ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [151ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [197ms] refreshing cache from master, [197ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [202ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [205ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [208ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [208ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [257ms] refreshing cache from master, [257ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [263ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [267ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [269ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [269ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [457ms] refreshing cache from master, [457ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [462ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@443950615(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@5bd44090 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733) -> (continuation of Deferred@178662517 after retry RPC@1727806133) -> (continuation of Deferred@1561459290 after retry RPC@594936219), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b389236 -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733) -> (continuation of Deferred@178662517 after retry RPC@1727806133) -> (continuation of Deferred@1561459290 after retry RPC@594936219))) after lookup
02:13:02.262 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] connecting to peer
02:13:02.263 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.264 [DEBUG - kudu-nio-2] (Connection.java:709) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] cleaning up while in state CONNECTING due to: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.264 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537) for tablet a516028a9cf64745858a1e842b83444b: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537
02:13:02.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.272389 31594 heartbeater.cc:499] Master 127.30.72.253:43289 was elected leader, sending a full tablet report...
02:13:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.305275 31733 heartbeater.cc:344] Connected to a master server at 127.30.72.252:34629
02:13:02.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.310624 31845 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "20101acdac3c441dafd6bffef696b832" instance_seqno: 1783476778361852) as {username='slave'} at 127.30.72.195:49721; Asking this server to re-register.
02:13:02.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.312099 31733 heartbeater.cc:461] Registering TS with master...
02:13:02.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.315207 31845 ts_manager.cc:194] Registered new tserver with Master: 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401)
02:13:02.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.353749 31593 heartbeater.cc:344] Connected to a master server at 127.30.72.252:34629
02:13:02.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.356714 31845 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "faa67f25f32e4f58a757a1029f321743" instance_seqno: 1783476776269996) as {username='slave'} at 127.30.72.194:48079; Asking this server to re-register.
02:13:02.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.357962 31593 heartbeater.cc:461] Registering TS with master...
02:13:02.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.360929 31845 ts_manager.cc:194] Registered new tserver with Master: faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:13:02.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.450799 31824 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b638ef232b154349aeceafd26f8be88a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce259de67dc842f383d730693779b017" member_type: VOTER last_known_addr { host: "127.30.72.254" port: 38557 } } peers { permanent_uuid: "b638ef232b154349aeceafd26f8be88a" member_type: VOTER last_known_addr { host: "127.30.72.253" port: 43289 } } peers { permanent_uuid: "c193153b0b9649b0aa7146a9c00013b6" member_type: VOTER last_known_addr { host: "127.30.72.252" port: 34629 } } }
02:13:02.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.451560 31824 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a [sys.catalog]: This master's current role is: LEADER
02:13:02.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.872876 31913 raft_consensus.cc:493] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0d84a035dc24b7f80d1053def8dc210)
02:13:02.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.873277 31913 raft_consensus.cc:515] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:13:02.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.875690 31913 leader_election.cc:290] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537), faa67f25f32e4f58a757a1029f321743 (127.30.72.194:46559)
02:13:02.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.878878 31623 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111)
02:13:02.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:02.883632 31623 leader_election.cc:336] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537): Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111)
02:13:02.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.887743 31547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "20101acdac3c441dafd6bffef696b832" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "faa67f25f32e4f58a757a1029f321743" is_pre_election: true
02:13:02.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.889436 31622 leader_election.cc:304] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20101acdac3c441dafd6bffef696b832; no voters: a0d84a035dc24b7f80d1053def8dc210, faa67f25f32e4f58a757a1029f321743
02:13:02.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:02.890264 31913 raft_consensus.cc:2749] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:13:03.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.056454 31918 raft_consensus.cc:493] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0d84a035dc24b7f80d1053def8dc210)
02:13:03.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.057305 31918 raft_consensus.cc:515] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:13:03.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.060228 31918 leader_election.cc:290] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401), a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537)
02:13:03.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.066017 31483 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111)
02:13:03.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.070729 31483 leader_election.cc:336] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537): Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111)
02:13:03.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.074286 31688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "faa67f25f32e4f58a757a1029f321743" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "20101acdac3c441dafd6bffef696b832" is_pre_election: true
02:13:03.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.074839 31688 raft_consensus.cc:2468] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faa67f25f32e4f58a757a1029f321743 in term 1.
02:13:03.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.075915 31483 leader_election.cc:304] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20101acdac3c441dafd6bffef696b832, faa67f25f32e4f58a757a1029f321743; no voters: a0d84a035dc24b7f80d1053def8dc210
02:13:03.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.076629 31918 raft_consensus.cc:2804] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:13:03.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.076983 31918 raft_consensus.cc:493] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0d84a035dc24b7f80d1053def8dc210)
02:13:03.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.077217 31918 raft_consensus.cc:3060] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 1 FOLLOWER]: Advancing to term 2
02:13:03.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.082485 31918 raft_consensus.cc:515] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:13:03.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.084048 31918 leader_election.cc:290] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [CANDIDATE]: Term 2 election: Requested vote from peers 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401), a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537)
02:13:03.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.084761 31688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a516028a9cf64745858a1e842b83444b" candidate_uuid: "faa67f25f32e4f58a757a1029f321743" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "20101acdac3c441dafd6bffef696b832"
02:13:03.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.085322 31688 raft_consensus.cc:3060] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 1 FOLLOWER]: Advancing to term 2
02:13:03.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.087796 31483 leader_election.cc:336] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537): Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111)
02:13:03.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.091687 31688 raft_consensus.cc:2468] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa67f25f32e4f58a757a1029f321743 in term 2.
02:13:03.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.092692 31483 leader_election.cc:304] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20101acdac3c441dafd6bffef696b832, faa67f25f32e4f58a757a1029f321743; no voters: a0d84a035dc24b7f80d1053def8dc210
02:13:03.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.093356 31918 raft_consensus.cc:2804] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 2 FOLLOWER]: Leader election won for term 2
02:13:03.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.095436 31918 raft_consensus.cc:697] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 2 LEADER]: Becoming Leader. State: Replica: faa67f25f32e4f58a757a1029f321743, State: Running, Role: LEADER
02:13:03.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.096930 31918 consensus_queue.cc:237] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } }
02:13:03.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.106326 31131 catalog_manager.cc:5697] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 reported cstate change: term changed from 1 to 2, leader changed from a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193) to faa67f25f32e4f58a757a1029f321743 (127.30.72.194). New cstate: current_term: 2 leader_uuid: "faa67f25f32e4f58a757a1029f321743" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0d84a035dc24b7f80d1053def8dc210" member_type: VOTER last_known_addr { host: "127.30.72.193" port: 43537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa67f25f32e4f58a757a1029f321743" member_type: VOTER last_known_addr { host: "127.30.72.194" port: 46559 } health_report { overall_health: HEALTHY } } }
02:13:03.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.583877 31688 raft_consensus.cc:1275] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 2 FOLLOWER]: Refusing update from remote peer faa67f25f32e4f58a757a1029f321743: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
02:13:03.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:03.585145 31918 consensus_queue.cc:1048] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20101acdac3c441dafd6bffef696b832" member_type: VOTER last_known_addr { host: "127.30.72.195" port: 40401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
02:13:03.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:03.619956 31483 consensus_peers.cc:597] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 -> Peer a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537): Couldn't send request to peer a0d84a035dc24b7f80d1053def8dc210. Status: Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:13:03.999 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a516028a9cf64745858a1e842b83444b for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:13:03.999 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a516028a9cf64745858a1e842b83444b@[20101acdac3c441dafd6bffef696b832(127.30.72.195:40401),a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537),faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)[L]]}]
02:13:04.000 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a516028a9cf64745858a1e842b83444b, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2201), Traces: [0ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [4ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [4ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [17ms] refreshing cache from master, [18ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.252:34629, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [77ms] Sub RPC GetTableLocations: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [96ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.254:38557, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.253:43289, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.72.252:34629, [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.252:34629: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [100ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.254:38557: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.30.72.253:43289: OK, [105ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [112ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [118ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [122ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [122ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [137ms] refreshing cache from master, [137ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [142ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [144ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [151ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [151ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [197ms] refreshing cache from master, [197ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [202ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [205ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [208ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [208ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [257ms] refreshing cache from master, [257ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [263ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [267ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [269ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [269ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [457ms] refreshing cache from master, [457ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [462ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, [464ms] sending RPC to server a0d84a035dc24b7f80d1053def8dc210, [466ms] received response from server a0d84a035dc24b7f80d1053def8dc210: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [466ms] delaying RPC due to: Network error: Failed to connect to peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537): Connection refused: /127.30.72.193:43537, [2196ms] refreshing cache from master, [2197ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.72.253:43289, [2200ms] Sub RPC GetTableLocations: received response from server master-127.30.72.253:43289: OK, deferred=Deferred@443950615(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$233/0x00007f7290336958@5bd44090 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733) -> (continuation of Deferred@178662517 after retry RPC@1727806133) -> (continuation of Deferred@1561459290 after retry RPC@594936219) -> (continuation of Deferred@51271981 after retry RPC@275249678), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b389236 -> wakeup thread Time-limited test -> (continuation of Deferred@722955641 after retry RPC@1333145023) -> (continuation of Deferred@831346448 after retry RPC@276797733) -> (continuation of Deferred@178662517 after retry RPC@1727806133) -> (continuation of Deferred@1561459290 after retry RPC@594936219) -> (continuation of Deferred@51271981 after retry RPC@275249678))) after lookup
02:13:04.001 [DEBUG - kudu-nio-1] (Connection.java:748) [peer faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)] connecting to peer
02:13:04.002 [DEBUG - kudu-nio-3] (Connection.java:757) [peer faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)] Successfully connected to peer
02:13:04.022 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x52428be2, L:/127.0.0.1:42362 - R:/127.30.72.194:46559] using TOKEN/null
02:13:04.200 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a516028a9cf64745858a1e842b83444b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:13:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.202659 31131 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33018:
02:13:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
02:13:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.203217 31131 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33018:
02:13:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
02:13:04.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.227463 31131 catalog_manager.cc:5984] T 00000000000000000000000000000000 P b638ef232b154349aeceafd26f8be88a: Sending DeleteTablet for 3 replicas of tablet a516028a9cf64745858a1e842b83444b
02:13:04.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.253999 31528 tablet_service.cc:1558] Processing DeleteTablet for tablet a516028a9cf64745858a1e842b83444b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 02:13:04 UTC) from {username='slave'} at 127.0.0.1:42370
02:13:04.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.257097 31963 tablet_replica.cc:333] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: stopping tablet replica
02:13:04.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.259080 31668 tablet_service.cc:1558] Processing DeleteTablet for tablet a516028a9cf64745858a1e842b83444b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 02:13:04 UTC) from {username='slave'} at 127.0.0.1:59514
02:13:04.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.259055 31963 raft_consensus.cc:2243] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 2 LEADER]: Raft consensus shutting down.
02:13:04.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.262795 31963 raft_consensus.cc:2272] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743 [term 2 FOLLOWER]: Raft consensus is shut down!
02:13:04.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.264623 31965 tablet_replica.cc:333] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: stopping tablet replica
02:13:04.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.265645 31965 raft_consensus.cc:2243] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 2 FOLLOWER]: Raft consensus shutting down.
02:13:04.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.266987 31963 ts_tablet_manager.cc:1916] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Deleting tablet data with delete state TABLET_DATA_DELETED
02:13:04.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.267019 31965 raft_consensus.cc:2272] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832 [term 2 FOLLOWER]: Raft consensus is shut down!
02:13:04.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.270323 31965 ts_tablet_manager.cc:1916] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Deleting tablet data with delete state TABLET_DATA_DELETED
02:13:04.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 02:13:04.271693 31117 catalog_manager.cc:4755] TS a0d84a035dc24b7f80d1053def8dc210 (127.30.72.193:43537): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a516028a9cf64745858a1e842b83444b: Network error: Client connection negotiation failed: client connection to 127.30.72.193:43537: connect: Connection refused (error 111)
02:13:04.275 [DEBUG - main] (Connection.java:575) [peer master-127.30.72.254:38557(127.30.72.254:38557)] disconnecting while in state READY
02:13:04.275 [DEBUG - main] (Connection.java:575) [peer master-127.30.72.253:43289(127.30.72.253:43289)] disconnecting while in state READY
02:13:04.275 [DEBUG - main] (Connection.java:575) [peer a0d84a035dc24b7f80d1053def8dc210(127.30.72.193:43537)] disconnecting while in state TERMINATED
02:13:04.275 [DEBUG - main] (Connection.java:575) [peer master-127.30.72.252:34629(127.30.72.252:34629)] disconnecting while in state READY
02:13:04.275 [DEBUG - main] (Connection.java:575) [peer faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)] disconnecting while in state READY
02:13:04.277 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.30.72.252:34629(127.30.72.252:34629)] handling channelInactive
02:13:04.277 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.72.252:34629(127.30.72.252:34629)] cleaning up while in state READY due to: connection closed
02:13:04.278 [DEBUG - kudu-nio-3] (Connection.java:239) [peer faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)] handling channelInactive
02:13:04.286 [DEBUG - kudu-nio-3] (Connection.java:709) [peer faa67f25f32e4f58a757a1029f321743(127.30.72.194:46559)] cleaning up while in state READY due to: connection closed
02:13:04.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.286810 31965 ts_tablet_manager.cc:1929] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
02:13:04.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.287470 31965 log.cc:1199] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Deleting WAL directory at /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-2/wal/wals/a516028a9cf64745858a1e842b83444b
02:13:04.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.288482 31965 ts_tablet_manager.cc:1950] T a516028a9cf64745858a1e842b83444b P 20101acdac3c441dafd6bffef696b832: Deleting consensus metadata
02:13:04.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.288581 31963 ts_tablet_manager.cc:1929] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
02:13:04.289 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.72.254:38557(127.30.72.254:38557)] handling channelInactive
02:13:04.289 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.72.254:38557(127.30.72.254:38557)] cleaning up while in state READY due to: connection closed
02:13:04.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.289073 31963 log.cc:1199] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Deleting WAL directory at /tmp/dist-test-task2lK8M4/test-tmp/mini-kudu-cluster17974658690212835762/ts-1/wal/wals/a516028a9cf64745858a1e842b83444b
02:13:04.290 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:13:04.290 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.72.253:43289(127.30.72.253:43289)] handling channelInactive
02:13:04.291 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.72.253:43289(127.30.72.253:43289)] cleaning up while in state READY due to: connection closed
02:13:04.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.290831 31963 ts_tablet_manager.cc:1950] T a516028a9cf64745858a1e842b83444b P faa67f25f32e4f58a757a1029f321743: Deleting consensus metadata
02:13:04.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.292326 31117 catalog_manager.cc:5028] TS 20101acdac3c441dafd6bffef696b832 (127.30.72.195:40401): tablet a516028a9cf64745858a1e842b83444b (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e94e10cc18064ca4a5f1c10fab987e86]) successfully deleted
02:13:04.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.293861 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31456
02:13:04.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.317380 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31603
02:13:04.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.348383 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31023
02:13:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.373478 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31093
02:13:04.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 02:13:04.409449 31011 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task2lK8M4/build/tsan/bin/kudu with pid 31790
02:13:05.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T02:13:05Z chronyd exiting

Time: 45.108

OK (2 tests)

