JUnit version 4.13.2
.02:03:49.742 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1786500229731
02:03:49.821 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:03:49.900 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:03:49.910 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskyzaRjo/test-tmp
02:03:49.917 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:03:49.920 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskyzaRjo/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:03:50.205 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:03:50.435 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:03:50.437 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:03:50.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.442955   406 mini_oidc.cc:150] Starting JWKS server
02:03:50.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.447652   406 webserver.cc:533] Webserver started at http://127.0.0.1:40429/ using document root <none> and password file <none>
02:03:50.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.448557   406 mini_oidc.cc:186] Starting OIDC Discovery server
02:03:50.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.450822   406 webserver.cc:533] Webserver started at http://127.0.0.1:43025/ using document root <none> and password file <none>
02:03:50.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T02:03:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:03:50.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T02:03:50Z Disabled control of system clock
02:03:50.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.530462   406 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:50.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:50.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal
02:03:50.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data
02:03:50.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:50.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:50.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:50.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:50.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:50.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:50.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/logs
02:03:50.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data/info.pb
02:03:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.190:43693
02:03:50.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.190
02:03:50.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:50.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:50.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:50.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:50.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:50.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:50.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:50.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:50.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40429/jwks.json with env {}
02:03:50.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.871976   421 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:50.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.873090   421 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:50.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.873780   421 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:50.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.910156   421 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.910467   421 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.910676   421 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:50.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.910897   421 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:50.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.911177   421 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:50.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.911331   421 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40429/jwks.json
02:03:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.952447   421 master_runner.cc:387] Master server non-default flags:
02:03:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/logs
02:03:50.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:50.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:50.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:50.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:50.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:50.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:50.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data
02:03:50.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal
02:03:50.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:50.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:50.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:50.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:50.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:50.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.190:43693
02:03:50.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:50.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:50.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40429/jwks.json
02:03:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data/info.pb
02:03:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.190
02:03:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:50.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:50.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:50.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:50.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:50.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:03:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:03:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:03:50.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:50.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.954005   421 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:50.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:50.956122   421 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:03:50.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.970746   432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:52.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.974948   437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:52.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:50.972949   433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:52.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.242606   421 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:52.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.243467   435 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:03:52.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.247831   421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:52.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.251711   421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.253445   421 hybrid_clock.cc:648] HybridClock initialized: now 1786500232253324 us; error 119 us; skew 500 ppm
02:03:52.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.254467   421 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:52.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.262029   421 webserver.cc:533] Webserver started at http://127.0.101.190:46161/ using document root <none> and password file <none>
02:03:52.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.263301   421 fs_manager.cc:362] Metadata directory not provided
02:03:52.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.263542   421 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:52.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.264134   421 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:52.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.269421   421 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data/instance:
02:03:52.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "003ff09a61864c199474cbbd2470d0fb"
02:03:52.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:52 on dist-test-slave-kvfs"
02:03:52.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.270953   421 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal/instance:
02:03:52.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "003ff09a61864c199474cbbd2470d0fb"
02:03:52.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:52 on dist-test-slave-kvfs"
02:03:52.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.281528   421 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.008s	sys 0.004s
02:03:52.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.288926   452 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:52.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.290630   421 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
02:03:52.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.291599   421 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal
02:03:52.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "003ff09a61864c199474cbbd2470d0fb"
02:03:52.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:52 on dist-test-slave-kvfs"
02:03:52.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.292263   421 fs_report.cc:389] FS layout report
02:03:52.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:52.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal
02:03:52.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal
02:03:52.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data/data
02:03:52.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:52.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:52.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:52.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:52.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:52.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:52.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:52.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:52.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:52.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:52.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:52.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.354748   421 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:52.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.356763   421 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:52.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.357347   421 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:52.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.448856   421 rpc_server.cc:307] RPC server started. Bound to: 127.0.101.190:43693
02:03:52.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.448894   536 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.101.190:43693 every 8 connection(s)
02:03:52.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.453224   421 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/data/info.pb
02:03:52.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.460896   537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:52.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.463330   406 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 421
02:03:52.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.464241   406 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-0/wal/instance
02:03:52.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.470047   406 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal
02:03:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data
02:03:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/logs
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data/info.pb
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:52.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:52.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:52.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:52.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.189:37875
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.189
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:52.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:52.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:52.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:52.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:52.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:52.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:52.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40429/jwks.json with env {}
02:03:52.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.479709   537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } has no permanent_uuid. Determining permanent_uuid...
02:03:52.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.512537   537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } has no permanent_uuid. Determining permanent_uuid...
02:03:52.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.515136   457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:52.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.519949   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:52.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.569686   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 1
02:03:52.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.575299   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:52.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.643939   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 2
02:03:52.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.648921   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:52.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.740574   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 3
02:03:52.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.746621   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:52.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.843706   541 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:52.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.844518   541 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:52.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.845276   541 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:52.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.879755   541 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:52.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.880604   541 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:52.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.881014   541 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:52.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.881402   541 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.881814   541 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:52.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.882120   541 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40429/jwks.json
02:03:52.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.890152   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 4
02:03:52.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.897946   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:52.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.943380   541 master_runner.cc:387] Master server non-default flags:
02:03:52.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/logs
02:03:52.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:52.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:52.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:52.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:52.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:52.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:52.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data
02:03:52.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal
02:03:52.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:52.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:52.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.189:37875
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40429/jwks.json
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:52.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:52.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data/info.pb
02:03:52.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.189
02:03:52.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:52.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:52.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:52.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:52.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:52.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:52.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:52.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:52.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:52.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:03:52.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:52.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:03:52.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:03:52.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:52.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.946704   541 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:52.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:52.950436   541 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:03:52.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.965633   553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:53.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:53.197479   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 5
02:03:53.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:53.204767   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:53.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:53.752524   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 6
02:03:53.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:53.761368   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.189:37875: Network error: Client connection negotiation failed: client connection to 127.0.101.189:37875: connect: Connection refused (error 111)
02:03:54.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.970562   557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:54.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.280833   558 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:03:54.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.281081   541 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:54.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:52.973028   559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:54.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.287317   541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:54.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.290899   541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:54.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.292668   541 hybrid_clock.cc:648] HybridClock initialized: now 1786500234292619 us; error 55 us; skew 500 ppm
02:03:54.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.293928   541 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:54.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.303799   541 webserver.cc:533] Webserver started at http://127.0.101.189:45351/ using document root <none> and password file <none>
02:03:54.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.305135   541 fs_manager.cc:362] Metadata directory not provided
02:03:54.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.305380   541 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:54.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.305874   541 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:54.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.311231   541 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data/instance:
02:03:54.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d9869ac4f8ae44d48c352052a2d402a7"
02:03:54.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:54 on dist-test-slave-kvfs"
02:03:54.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.312925   541 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal/instance:
02:03:54.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d9869ac4f8ae44d48c352052a2d402a7"
02:03:54.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:54 on dist-test-slave-kvfs"
02:03:54.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.325937   541 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.008s	sys 0.004s
02:03:54.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.334147   571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:54.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.335901   541 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.004s
02:03:54.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.336428   541 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal
02:03:54.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d9869ac4f8ae44d48c352052a2d402a7"
02:03:54.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:54 on dist-test-slave-kvfs"
02:03:54.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.336830   541 fs_report.cc:389] FS layout report
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data/data
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:54.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:54.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:54.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.401850   541 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.403414   541 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.403858   541 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:54.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.495735   541 rpc_server.cc:307] RPC server started. Bound to: 127.0.101.189:37875
02:03:54.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.495841   652 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.101.189:37875 every 8 connection(s)
02:03:54.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.499531   541 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/data/info.pb
02:03:54.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.501467   406 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 541
02:03:54.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.502097   406 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-1/wal/instance
02:03:54.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.506121   406 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal
02:03:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data
02:03:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:54.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:54.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/logs
02:03:54.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data/info.pb
02:03:54.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:54.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:54.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.188:36233
02:03:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.188
02:03:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:54.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:54.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:54.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:54.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:54.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:54.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:54.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40429/jwks.json with env {}
02:03:54.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.514765   653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:54.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.530237   653 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } has no permanent_uuid. Determining permanent_uuid...
02:03:54.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.564867   653 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } has no permanent_uuid. Determining permanent_uuid...
02:03:54.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.581481   653 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } has no permanent_uuid. Determining permanent_uuid...
02:03:54.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.584105   576 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.588941   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.638659   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 1
02:03:54.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.645663   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.714166   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 2
02:03:54.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.719251   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.810709   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 3
02:03:54.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.816852   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.822175   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } attempt: 7
02:03:54.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.836831   537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } has no permanent_uuid. Determining permanent_uuid...
02:03:54.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.843416   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.899426   657 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:54.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.900456   657 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:54.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.901144   657 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:54.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.902035   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 1
02:03:54.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.907956   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.937913   657 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:54.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.938232   657 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:54.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.938436   657 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:54.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.938642   657 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:54.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.938925   657 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:54.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.939177   657 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40429/jwks.json
02:03:54.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.960281   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 4
02:03:54.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.965229   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.985831   657 master_runner.cc:387] Master server non-default flags:
02:03:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/logs
02:03:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data
02:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal
02:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.188:36233
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40429/jwks.json
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data/info.pb
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.188
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:03:54.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:03:54.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:54.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.987761   657 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:54.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.990530   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 2
02:03:54.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:54.991016   657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:03:54.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:54.996548   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.006852   675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:55.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:55.082134   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 3
02:03:55.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.100826   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:55.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:55.252945   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 4
02:03:55.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:55.264696   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 5
02:03:55.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.281224   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:55.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.297531   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:55.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:55.587947   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 5
02:03:55.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.602809   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:55.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:55.829145   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 6
02:03:55.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.858336   653 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:56.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.156124   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 6
02:03:56.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.182456   537 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.101.188:36233: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:03:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.414641   674 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee00 after lost signal to thread 657
02:03:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.508482   657 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.501s	user 0.456s	sys 1.021s
02:03:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:55.008405   678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.511224   657 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.503s	user 0.457s	sys 1.022s
02:03:56.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.512593   681 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1500 milliseconds
02:03:56.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.514114   657 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:56.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.514407   685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:56.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.518414   657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:56.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.521739   657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:56.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.523114   657 hybrid_clock.cc:648] HybridClock initialized: now 1786500236523089 us; error 59 us; skew 500 ppm
02:03:56.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.523948   657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.530988   657 webserver.cc:533] Webserver started at http://127.0.101.188:37709/ using document root <none> and password file <none>
02:03:56.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.532176   657 fs_manager.cc:362] Metadata directory not provided
02:03:56.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.532415   657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:56.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.532828   657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:56.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.537786   657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data/instance:
02:03:56.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d025a483a65e476ca39bae97f97ec77e"
02:03:56.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:56 on dist-test-slave-kvfs"
02:03:56.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.538975   657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal/instance:
02:03:56.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d025a483a65e476ca39bae97f97ec77e"
02:03:56.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:56 on dist-test-slave-kvfs"
02:03:56.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.549306   657 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.002s
02:03:56.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.556972   709 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:56.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.559296   657 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.004s
02:03:56.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.559652   657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal
02:03:56.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d025a483a65e476ca39bae97f97ec77e"
02:03:56.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:03:56 on dist-test-slave-kvfs"
02:03:56.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.559973   657 fs_report.cc:389] FS layout report
02:03:56.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:56.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data/data
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:56.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:56.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:56.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:56.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.634570   657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:56.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.636621   657 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:56.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.637365   657 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:56.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.737872   657 rpc_server.cc:307] RPC server started. Bound to: 127.0.101.188:36233
02:03:56.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.737995   779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.101.188:36233 every 8 connection(s)
02:03:56.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.741384   657 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/data/info.pb
02:03:56.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.747468   406 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 657
02:03:56.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.747941   406 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/master-2/wal/instance
02:03:56.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.749163   781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:56.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.768747   781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.802445   781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.813853   781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.834606   781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: Bootstrap starting.
02:03:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.845625   781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: Neither blocks nor log segments found. Creating new log.
02:03:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.848209   781 log.cc:826] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: Log is configured to *not* fsync() on all Append() calls
02:03:56.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.855348   781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: No bootstrap required, opened a new log
02:03:56.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.880517   781 raft_consensus.cc:359] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:56.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.881659   781 raft_consensus.cc:385] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.881882   781 raft_consensus.cc:740] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d025a483a65e476ca39bae97f97ec77e, State: Initialized, Role: FOLLOWER
02:03:56.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.883633   781 consensus_queue.cc:260] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:56.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.888268   793 sys_catalog.cc:455] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:56.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.889055   793 sys_catalog.cc:458] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: This master's current role is: FOLLOWER
02:03:56.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.890683   781 sys_catalog.cc:565] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: configured and running, proceeding with master startup.
02:03:56.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.895277   718 tablet.cc:2406] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:56.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.919260   653 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 7
02:03:56.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.935384   810 catalog_manager.cc:1594] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:03:56.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:56.936796   810 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:03:56.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.959421   653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: Bootstrap starting.
02:03:56.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.961241   793 raft_consensus.cc:493] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:03:56.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.961933   793 raft_consensus.cc:515] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:56.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.929600   657 master_runner.cc:187] Error getting master registration for 127.0.101.190:43693: OK, instance_id { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" instance_seqno: 1786500232423956 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:03:56.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.964872   657 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:03:56.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.972853   793 leader_election.cc:290] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 003ff09a61864c199474cbbd2470d0fb (127.0.101.190:43693), d9869ac4f8ae44d48c352052a2d402a7 (127.0.101.189:37875)
02:03:56.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.977223   653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: Neither blocks nor log segments found. Creating new log.
02:03:56.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.980436   653 log.cc:826] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: Log is configured to *not* fsync() on all Append() calls
02:03:56.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:56.990363   653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: No bootstrap required, opened a new log
02:03:57.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.031919   653 raft_consensus.cc:359] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:57.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.033785   653 raft_consensus.cc:385] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.034612   653 raft_consensus.cc:740] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9869ac4f8ae44d48c352052a2d402a7, State: Initialized, Role: FOLLOWER
02:03:57.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.036521   653 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:57.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.040473   813 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.042156   813 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: This master's current role is: FOLLOWER
02:03:57.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.042642   653 sys_catalog.cc:565] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: configured and running, proceeding with master startup.
02:03:57.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.043131   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d025a483a65e476ca39bae97f97ec77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9869ac4f8ae44d48c352052a2d402a7" is_pre_election: true
02:03:57.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.044787   611 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d025a483a65e476ca39bae97f97ec77e in term 0.
02:03:57.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.047214   714 leader_election.cc:304] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d025a483a65e476ca39bae97f97ec77e, d9869ac4f8ae44d48c352052a2d402a7; no voters: 
02:03:57.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.048326   793 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Leader pre-election won for term 1
02:03:57.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.048708   793 raft_consensus.cc:493] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:03:57.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.049039   793 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 0 FOLLOWER]: Advancing to term 1
02:03:57.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.064067   793 raft_consensus.cc:515] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:57.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.076647   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d025a483a65e476ca39bae97f97ec77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9869ac4f8ae44d48c352052a2d402a7"
02:03:57.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.077368   611 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 0 FOLLOWER]: Advancing to term 1
02:03:57.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.099326   793 leader_election.cc:290] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [CANDIDATE]: Term 1 election: Requested vote from peers 003ff09a61864c199474cbbd2470d0fb (127.0.101.190:43693), d9869ac4f8ae44d48c352052a2d402a7 (127.0.101.189:37875)
02:03:57.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.109252   611 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d025a483a65e476ca39bae97f97ec77e in term 1.
02:03:57.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.111852   714 leader_election.cc:304] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d025a483a65e476ca39bae97f97ec77e, d9869ac4f8ae44d48c352052a2d402a7; no voters: 
02:03:57.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.114081   793 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 1 FOLLOWER]: Leader election won for term 1
02:03:57.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.127655   793 raft_consensus.cc:697] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [term 1 LEADER]: Becoming Leader. State: Replica: d025a483a65e476ca39bae97f97ec77e, State: Running, Role: LEADER
02:03:57.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.130158   793 consensus_queue.cc:237] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:57.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.151664   832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d025a483a65e476ca39bae97f97ec77e. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.154367   832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: This master's current role is: LEADER
02:03:57.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:57.163926   579 tablet.cc:2406] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:57.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.167766   837 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:03:57.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.131964   541 master_runner.cc:187] Error getting master registration for 127.0.101.190:43693: OK, instance_id { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" instance_seqno: 1786500232423956 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:03:57.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.173002   541 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:03:57.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:57.175307   834 catalog_manager.cc:1594] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:03:57.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:57.175686   834 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:03:57.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.204056   837 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:03:57.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.216238   537 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } attempt: 7
02:03:57.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.242102   611 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Refusing update from remote peer d025a483a65e476ca39bae97f97ec77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:03:57.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.246141   793 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:03:57.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.297273   813 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d025a483a65e476ca39bae97f97ec77e. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.298115   537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: Bootstrap starting.
02:03:57.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.299046   813 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: This master's current role is: FOLLOWER
02:03:57.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.308256   537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: Neither blocks nor log segments found. Creating new log.
02:03:57.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.311173   537 log.cc:826] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: Log is configured to *not* fsync() on all Append() calls
02:03:57.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.315546   839 mvcc.cc:204] Tried to move back new op lower bound from 7317504971705528320 to 7317504971304247296. Current Snapshot: MvccSnapshot[applied={T|T < 7317504971705528320}]
02:03:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.323767   813 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.324766   813 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: This master's current role is: FOLLOWER
02:03:57.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.346201   832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.346987   832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: This master's current role is: LEADER
02:03:57.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.348343   837 catalog_manager.cc:1383] Generated new cluster ID: 9e37ac7618a342d6b90fcdfea4ad40c6
02:03:57.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.348673   837 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:03:57.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.382678   537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: No bootstrap required, opened a new log
02:03:57.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.426965   537 raft_consensus.cc:359] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:57.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.427958   537 raft_consensus.cc:385] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:57.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.428290   537 raft_consensus.cc:740] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 003ff09a61864c199474cbbd2470d0fb, State: Initialized, Role: FOLLOWER
02:03:57.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.429415   537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:03:57.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.436254   837 catalog_manager.cc:1406] Generated new certificate authority record
02:03:57.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.439659   837 catalog_manager.cc:1540] Loading token signing keys...
02:03:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.441521   846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.442423   846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: This master's current role is: FOLLOWER
02:03:57.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.460003   537 sys_catalog.cc:565] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: configured and running, proceeding with master startup.
02:03:57.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.462596   496 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 0 FOLLOWER]: Advancing to term 1
02:03:57.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.463534   497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d025a483a65e476ca39bae97f97ec77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "003ff09a61864c199474cbbd2470d0fb"
02:03:57.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.460404   498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d025a483a65e476ca39bae97f97ec77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "003ff09a61864c199474cbbd2470d0fb" is_pre_election: true
02:03:57.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.522058   837 catalog_manager.cc:6092] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e: Generated new TSK 0
02:03:57.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.523531   837 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:03:57.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.535733   496 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 1 FOLLOWER]: Refusing update from remote peer d025a483a65e476ca39bae97f97ec77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:03:57.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.538825   793 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.566607   406 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:57.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/logs
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data/info.pb
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:57.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.129:0
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.101.129
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.129
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:57.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:03:57.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:57.623598   466 tablet.cc:2406] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.681185   846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d025a483a65e476ca39bae97f97ec77e. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.682119   846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: This master's current role is: FOLLOWER
02:03:57.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.683339   879 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:03:57.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.683202   865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:57.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:57.685271   865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: This master's current role is: FOLLOWER
02:03:58.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.012616   793 sys_catalog.cc:455] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d025a483a65e476ca39bae97f97ec77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:03:58.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.015026   793 sys_catalog.cc:458] T 00000000000000000000000000000000 P d025a483a65e476ca39bae97f97ec77e [sys.catalog]: This master's current role is: LEADER
02:03:58.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.183060   834 catalog_manager.cc:1295] Loaded cluster ID: 9e37ac7618a342d6b90fcdfea4ad40c6
02:03:58.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.183840   834 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: loading cluster ID for follower catalog manager: success
02:03:58.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.193436   834 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: acquiring CA information for follower catalog manager: success
02:03:58.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.202065   834 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:03:58.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.210703   856 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:58.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.211421   856 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:58.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.212203   856 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:58.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.253973   856 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:58.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.255586   856 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.101.129
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.302687   856 tablet_server_runner.cc:78] Tablet server non-default flags:
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/logs
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:03:58.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:58.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.129:0
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:58.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data/info.pb
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.129
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.101.129
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:58.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:03:58.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:58.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:03:58.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:03:58.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:58.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.304672   856 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:58.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.307413   856 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:03:58.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.329954   891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:58.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.715962   879 catalog_manager.cc:1295] Loaded cluster ID: 9e37ac7618a342d6b90fcdfea4ad40c6
02:03:58.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.720254   879 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: loading cluster ID for follower catalog manager: success
02:03:58.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.765327   879 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: acquiring CA information for follower catalog manager: success
02:03:58.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:03:58.802553   879 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:00.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:59.730201   889 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 856
02:04:00.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:00.796790   889 kernel_stack_watchdog.cc:198] Thread 856 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 396ms:
02:04:00.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:00.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:00.802270   856 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.471s	user 0.521s	sys 0.852s
02:04:00.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:00.802758   856 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.472s	user 0.521s	sys 0.852s
02:04:00.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:03:58.332513   892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:00.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:00.814788   900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:00.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.816111   856 server_base.cc:1061] running on GCE node
02:04:00.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.817608   856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:00.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.822099   856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:00.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.823724   856 hybrid_clock.cc:648] HybridClock initialized: now 1786500240823564 us; error 57 us; skew 500 ppm
02:04:00.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.825052   856 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:00.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.847505   856 webserver.cc:533] Webserver started at http://127.0.101.129:42883/ using document root <none> and password file <none>
02:04:00.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.849110   856 fs_manager.cc:362] Metadata directory not provided
02:04:00.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.849464   856 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:00.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.850201   856 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:00.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.863410   856 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data/instance:
02:04:00.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16986928e6614ee6a68f08ba9012e42e"
02:04:00.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:00 on dist-test-slave-kvfs"
02:04:00.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.866487   856 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal/instance:
02:04:00.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16986928e6614ee6a68f08ba9012e42e"
02:04:00.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:00 on dist-test-slave-kvfs"
02:04:00.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.894948   856 fs_manager.cc:696] Time spent creating directory manager: real 0.027s	user 0.015s	sys 0.010s
02:04:00.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.919834   910 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:00.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.921389   856 fs_manager.cc:730] Time spent opening block manager: real 0.021s	user 0.001s	sys 0.017s
02:04:00.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.921859   856 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal
02:04:00.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16986928e6614ee6a68f08ba9012e42e"
02:04:00.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:00 on dist-test-slave-kvfs"
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:00.922555   856 fs_report.cc:389] FS layout report
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data/data
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:00.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:00.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:00.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:00.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:00.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:00.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:00.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:01.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.016939   856 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:01.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.019261   856 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:01.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.019829   856 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:01.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.023530   856 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:01.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.029467   856 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:01.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.029805   856 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:01.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.030048   856 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:01.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.030200   856 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:01.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.339674   856 rpc_server.cc:307] RPC server started. Bound to: 127.0.101.129:44683
02:04:01.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.339836  1081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.101.129:44683 every 8 connection(s)
02:04:01.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.342826   856 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/data/info.pb
02:04:01.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.344631   406 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 856
02:04:01.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.345342   406 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal/instance
02:04:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.365459   406 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal
02:04:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data
02:04:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/logs
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data/info.pb
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:01.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.130:0
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.101.130
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.130
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:04:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:04:01.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:01.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:01.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.455806  1082 heartbeater.cc:344] Connected to a master server at 127.0.101.188:36233
02:04:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.456488  1082 heartbeater.cc:461] Registering TS with master...
02:04:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.459090  1082 heartbeater.cc:507] Master 127.0.101.188:36233 requested a full tablet report, sending...
02:04:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.460232  1084 heartbeater.cc:344] Connected to a master server at 127.0.101.189:37875
02:04:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.460764  1084 heartbeater.cc:461] Registering TS with master...
02:04:01.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.461864  1084 heartbeater.cc:507] Master 127.0.101.189:37875 requested a full tablet report, sending...
02:04:01.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.464507   730 ts_manager.cc:194] Registered new tserver with Master: 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683)
02:04:01.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.467533   730 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.101.129:34731
02:04:01.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.470832   596 ts_manager.cc:194] Registered new tserver with Master: 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683)
02:04:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.482803  1085 heartbeater.cc:344] Connected to a master server at 127.0.101.190:43693
02:04:01.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.483402  1085 heartbeater.cc:461] Registering TS with master...
02:04:01.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.484159  1085 heartbeater.cc:507] Master 127.0.101.190:43693 requested a full tablet report, sending...
02:04:01.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.488121   483 ts_manager.cc:194] Registered new tserver with Master: 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683)
02:04:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.859757  1090 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.860455  1090 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:01.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.861071  1090 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:01.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.903744  1090 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:01.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.905176  1090 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.101.130
02:04:01.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.948102  1090 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:01.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/logs
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:01.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.130:0
02:04:01.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data/info.pb
02:04:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.130
02:04:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:01.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:04:01.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:01.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.101.130
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:01.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.950146  1090 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:01.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:01.953667  1090 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:01.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.974212  1107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:02.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:02.481858  1082 heartbeater.cc:499] Master 127.0.101.188:36233 was elected leader, sending a full tablet report...
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:03.380709  1105 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 1090
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:04.136502  1105 kernel_stack_watchdog.cc:198] Thread 1090 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 396ms:
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:04.137244  1090 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.158s	user 0.688s	sys 1.310s
02:04:04.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:04.137701  1090 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.159s	user 0.688s	sys 1.310s
02:04:04.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:01.982723  1110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:04.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:04.139408  1111 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2154 milliseconds
02:04:04.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.140595  1090 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:04.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:04.140666  1113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:04.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.144306  1090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:04.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.146662  1090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:04.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.148097  1090 hybrid_clock.cc:648] HybridClock initialized: now 1786500244148039 us; error 63 us; skew 500 ppm
02:04:04.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.148976  1090 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:04.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.155418  1090 webserver.cc:533] Webserver started at http://127.0.101.130:36807/ using document root <none> and password file <none>
02:04:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.156509  1090 fs_manager.cc:362] Metadata directory not provided
02:04:04.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.156741  1090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:04.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.157188  1090 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.162938  1090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data/instance:
02:04:04.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "794d4b8244cc430982b3b3e14eb8bcf3"
02:04:04.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:04 on dist-test-slave-kvfs"
02:04:04.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.164809  1090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal/instance:
02:04:04.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "794d4b8244cc430982b3b3e14eb8bcf3"
02:04:04.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:04 on dist-test-slave-kvfs"
02:04:04.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.175815  1090 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.001s
02:04:04.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.184345  1130 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.186353  1090 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.002s	sys 0.005s
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.186796  1090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "794d4b8244cc430982b3b3e14eb8bcf3"
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:04 on dist-test-slave-kvfs"
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.187125  1090 fs_report.cc:389] FS layout report
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data/data
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:04.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:04.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:04.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:04.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:04.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:04.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:04.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.243698  1090 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:04.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.245549  1090 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:04.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.246142  1090 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:04.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.249053  1090 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:04.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.254256  1090 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:04.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.254539  1090 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:04.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.254848  1090 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:04.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.255477  1090 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
02:04:04.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.525895  1090 rpc_server.cc:307] RPC server started. Bound to: 127.0.101.130:33825
02:04:04.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.526309  1302 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.101.130:33825 every 8 connection(s)
02:04:04.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.530026  1090 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/data/info.pb
02:04:04.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.536966   406 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 1090
02:04:04.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.537539   406 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal/instance
02:04:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.554940   406 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal
02:04:04.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data
02:04:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:04.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/logs
02:04:04.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data/info.pb
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.131:0
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.101.131
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.131
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:04.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:04:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:04:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:04.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:04.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.608387  1303 heartbeater.cc:344] Connected to a master server at 127.0.101.188:36233
02:04:04.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.608963  1303 heartbeater.cc:461] Registering TS with master...
02:04:04.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.611088  1303 heartbeater.cc:507] Master 127.0.101.188:36233 requested a full tablet report, sending...
02:04:04.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.615434   730 ts_manager.cc:194] Registered new tserver with Master: 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:04.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.617658   730 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.101.130:58767
02:04:04.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.618609  1304 heartbeater.cc:344] Connected to a master server at 127.0.101.189:37875
02:04:04.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.619223  1304 heartbeater.cc:461] Registering TS with master...
02:04:04.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.621183  1304 heartbeater.cc:507] Master 127.0.101.189:37875 requested a full tablet report, sending...
02:04:04.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.626355   596 ts_manager.cc:194] Registered new tserver with Master: 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:04.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.629562  1310 heartbeater.cc:344] Connected to a master server at 127.0.101.190:43693
02:04:04.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.630079  1310 heartbeater.cc:461] Registering TS with master...
02:04:04.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.630920  1310 heartbeater.cc:507] Master 127.0.101.190:43693 requested a full tablet report, sending...
02:04:04.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:04.634024   483 ts_manager.cc:194] Registered new tserver with Master: 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:05.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.018096  1311 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:05.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.018647  1311 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:05.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.019091  1311 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:05.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.057812  1311 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:05.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.058710  1311 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.101.131
02:04:05.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:05.103226  1311 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:05.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/logs
02:04:05.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:05.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:05.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.0.101.148:45667
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.0.101.131:0
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data/info.pb
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.0.101.131
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.0.101.131
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:05.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:05.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:05.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:05.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:05.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:05.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:05.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:05.104871  1311 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:05.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:05.106594  1311 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:05.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.122766  1331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:05.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:05.625293  1303 heartbeater.cc:499] Master 127.0.101.188:36233 was elected leader, sending a full tablet report...
02:04:06.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:05.124804  1332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:06.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:06.613412  1334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:06.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:06.618794  1333 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1487 milliseconds
02:04:06.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.618906  1311 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:06.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.622673  1311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.625881  1311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.627391  1311 hybrid_clock.cc:648] HybridClock initialized: now 1786500246627351 us; error 59 us; skew 500 ppm
02:04:06.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.628594  1311 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:06.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.641109  1311 webserver.cc:533] Webserver started at http://127.0.101.131:36753/ using document root <none> and password file <none>
02:04:06.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.642299  1311 fs_manager.cc:362] Metadata directory not provided
02:04:06.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.642560  1311 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:06.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.643080  1311 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.649685  1311 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data/instance:
02:04:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9f4d3459cbba453fb83e4f5d6f261ecc"
02:04:06.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:06 on dist-test-slave-kvfs"
02:04:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.651149  1311 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal/instance:
02:04:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9f4d3459cbba453fb83e4f5d6f261ecc"
02:04:06.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:06 on dist-test-slave-kvfs"
02:04:06.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.661329  1311 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
02:04:06.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.669169  1347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:06.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.670647  1311 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
02:04:06.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.670993  1311 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal
02:04:06.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9f4d3459cbba453fb83e4f5d6f261ecc"
02:04:06.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:06 on dist-test-slave-kvfs"
02:04:06.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.671334  1311 fs_report.cc:389] FS layout report
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data/data
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:06.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:06.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:06.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:06.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:06.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:06.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:06.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.739785  1311 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:06.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.741681  1311 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:06.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.742252  1311 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:06.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.747136  1311 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.753806  1311 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.754088  1311 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.754388  1311 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.754644  1311 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.994261  1311 rpc_server.cc:307] RPC server started. Bound to: 127.0.101.131:33449
02:04:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.994375  1535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.101.131:33449 every 8 connection(s)
02:04:06.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:06.997700  1311 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/data/info.pb
02:04:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.006785   406 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 1311
02:04:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.007421   406 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-2/wal/instance
02:04:07.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.055845  1536 heartbeater.cc:344] Connected to a master server at 127.0.101.188:36233
02:04:07.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.056526  1536 heartbeater.cc:461] Registering TS with master...
02:04:07.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.061204  1536 heartbeater.cc:507] Master 127.0.101.188:36233 requested a full tablet report, sending...
02:04:07.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.065522   730 ts_manager.cc:194] Registered new tserver with Master: 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:07.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.067839  1537 heartbeater.cc:344] Connected to a master server at 127.0.101.189:37875
02:04:07.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.068313  1537 heartbeater.cc:461] Registering TS with master...
02:04:07.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.068274  1541 heartbeater.cc:344] Connected to a master server at 127.0.101.190:43693
02:04:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.068754  1541 heartbeater.cc:461] Registering TS with master...
02:04:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.068099   730 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.101.131:39331
02:04:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.069492  1537 heartbeater.cc:507] Master 127.0.101.189:37875 requested a full tablet report, sending...
02:04:07.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.069772  1541 heartbeater.cc:507] Master 127.0.101.190:43693 requested a full tablet report, sending...
02:04:07.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.073298   596 ts_manager.cc:194] Registered new tserver with Master: 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:07.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.073570   483 ts_manager.cc:194] Registered new tserver with Master: 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:07.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:07.099344   406 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:04:07.114 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:07.115 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:04:07.127 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.0.101.190"
      port: 43693
    }
    bound_http_address {
      host: "127.0.101.190"
      port: 46161
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.0.101.189"
      port: 37875
    }
    bound_http_address {
      host: "127.0.101.189"
      port: 45351
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.0.101.188"
      port: 36233
    }
    bound_http_address {
      host: "127.0.101.188"
      port: 37709
    }
  }
}

02:04:07.131 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:04:07.134 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.0.101.129"
      port: 44683
    }
    bound_http_address {
      host: "127.0.101.129"
      port: 42883
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.0.101.130"
      port: 33825
    }
    bound_http_address {
      host: "127.0.101.130"
      port: 36807
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.0.101.131"
      port: 33449
    }
    bound_http_address {
      host: "127.0.101.131"
      port: 36753
    }
  }
}

02:04:07.135 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:04:07.369 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
02:04:07.437 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:04:07.669 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.0.101.190:43693(127.0.101.190:43693)] connecting to peer
02:04:07.737 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.0.101.189:37875(127.0.101.189:37875)] connecting to peer
02:04:07.739 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:07.764 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.0.101.190:43693(127.0.101.190:43693)] Successfully connected to peer
02:04:07.765 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.0.101.189:37875(127.0.101.189:37875)] Successfully connected to peer
02:04:07.769 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.0.101.188:36233(127.0.101.188:36233)] Successfully connected to peer
02:04:07.884 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.0.101.189
02:04:07.884 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.0.101.190
02:04:07.886 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.0.101.188
02:04:08.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.076402  1536 heartbeater.cc:499] Master 127.0.101.188:36233 was elected leader, sending a full tablet report...
02:04:08.206 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xc2baed8e, L:/127.0.0.1:54908 - R:/127.0.101.189:37875] using SASL/PLAIN
02:04:08.206 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xd9d5861f, L:/127.0.0.1:53626 - R:/127.0.101.188:36233] using SASL/PLAIN
02:04:08.206 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xabc1b8c4, L:/127.0.0.1:53644 - R:/127.0.101.190:43693] using SASL/PLAIN
02:04:08.252 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:08.255 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=634), Traces: [0ms] refreshing cache from master, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [598ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: OK, deferred=null) after lookup
02:04:08.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.319268   730 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53626:
02:04:08.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:04:08.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:04:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:04:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:04:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:04:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:08.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:08.324329   730 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:04:08.426 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b8465bb472c4856835ebcedd5e64898
02:04:08.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.472877  1424 tablet_service.cc:1511] Processing CreateTablet for tablet 81e55b831d044bf79df32a98e67747fd (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:08.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.475636  1424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e55b831d044bf79df32a98e67747fd. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:08.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.489843   980 tablet_service.cc:1511] Processing CreateTablet for tablet 81e55b831d044bf79df32a98e67747fd (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:08.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.489827  1201 tablet_service.cc:1511] Processing CreateTablet for tablet 81e55b831d044bf79df32a98e67747fd (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:08.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.492944  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e55b831d044bf79df32a98e67747fd. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:08.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.500293   980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e55b831d044bf79df32a98e67747fd. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:08.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.571133  1599 tablet_bootstrap.cc:492] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: Bootstrap starting.
02:04:08.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.573441  1601 tablet_bootstrap.cc:492] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Bootstrap starting.
02:04:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.602900  1599 tablet_bootstrap.cc:654] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: Neither blocks nor log segments found. Creating new log.
02:04:08.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.605684  1599 log.cc:826] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: Log is configured to *not* fsync() on all Append() calls
02:04:08.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.621253  1599 tablet_bootstrap.cc:492] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: No bootstrap required, opened a new log
02:04:08.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.622794  1603 tablet_bootstrap.cc:492] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Bootstrap starting.
02:04:08.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.638691  1599 ts_tablet_manager.cc:1403] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.008s
02:04:08.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.640281  1603 tablet_bootstrap.cc:654] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Neither blocks nor log segments found. Creating new log.
02:04:08.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.643391  1603 log.cc:826] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Log is configured to *not* fsync() on all Append() calls
02:04:08.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.646345  1601 tablet_bootstrap.cc:654] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Neither blocks nor log segments found. Creating new log.
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.649405  1601 log.cc:826] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Log is configured to *not* fsync() on all Append() calls
02:04:08.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.655457  1603 tablet_bootstrap.cc:492] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: No bootstrap required, opened a new log
02:04:08.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.659617  1603 ts_tablet_manager.cc:1403] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.012s
02:04:08.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.679239  1601 tablet_bootstrap.cc:492] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: No bootstrap required, opened a new log
02:04:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.680822  1601 ts_tablet_manager.cc:1403] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.003s
02:04:08.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.702402  1603 raft_consensus.cc:359] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.703430  1603 raft_consensus.cc:385] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:08.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.703755  1603 raft_consensus.cc:740] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16986928e6614ee6a68f08ba9012e42e, State: Initialized, Role: FOLLOWER
02:04:08.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.705109  1603 consensus_queue.cc:260] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.705930  1599 raft_consensus.cc:359] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.707087  1599 raft_consensus.cc:385] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:08.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.708366  1599 raft_consensus.cc:740] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f4d3459cbba453fb83e4f5d6f261ecc, State: Initialized, Role: FOLLOWER
02:04:08.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.710008  1599 consensus_queue.cc:260] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.717847  1603 ts_tablet_manager.cc:1434] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Time spent starting tablet: real 0.058s	user 0.040s	sys 0.011s
02:04:08.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.749940  1601 raft_consensus.cc:359] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.756605  1601 raft_consensus.cc:385] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:08.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.757004  1601 raft_consensus.cc:740] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794d4b8244cc430982b3b3e14eb8bcf3, State: Initialized, Role: FOLLOWER
02:04:08.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.763599  1599 ts_tablet_manager.cc:1434] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: Time spent starting tablet: real 0.123s	user 0.048s	sys 0.018s
02:04:08.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.764854  1601 consensus_queue.cc:260] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:08.778146  1548 tablet.cc:2406] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:08.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.813339  1601 ts_tablet_manager.cc:1434] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Time spent starting tablet: real 0.132s	user 0.051s	sys 0.032s
02:04:08.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.850087  1609 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:08.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.850762  1609 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.860227  1609 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683), 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:08.876784  1315 tablet.cc:2406] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:08.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.889551  1010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16986928e6614ee6a68f08ba9012e42e" is_pre_election: true
02:04:08.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.890722  1010 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4d3459cbba453fb83e4f5d6f261ecc in term 0.
02:04:08.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.891995  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" is_pre_election: true
02:04:08.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.893002  1225 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f4d3459cbba453fb83e4f5d6f261ecc in term 0.
02:04:08.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.893455  1353 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e, 9f4d3459cbba453fb83e4f5d6f261ecc; no voters: 
02:04:08.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.894830  1609 raft_consensus.cc:2804] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:08.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.895236  1609 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:08.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.895568  1609 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 0 FOLLOWER]: Advancing to term 1
02:04:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.900946  1609 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:08.901664  1089 tablet.cc:2406] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.906059  1010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16986928e6614ee6a68f08ba9012e42e"
02:04:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.906708  1010 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 0 FOLLOWER]: Advancing to term 1
02:04:08.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.906889  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794d4b8244cc430982b3b3e14eb8bcf3"
02:04:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.907539  1225 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 0 FOLLOWER]: Advancing to term 1
02:04:08.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.905239  1609 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [CANDIDATE]: Term 1 election: Requested vote from peers 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683), 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:08.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.912781  1010 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4d3459cbba453fb83e4f5d6f261ecc in term 1.
02:04:08.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.914116  1353 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e, 9f4d3459cbba453fb83e4f5d6f261ecc; no voters: 
02:04:08.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.915105  1609 raft_consensus.cc:2804] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 1 FOLLOWER]: Leader election won for term 1
02:04:08.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.918466  1609 raft_consensus.cc:697] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [term 1 LEADER]: Becoming Leader. State: Replica: 9f4d3459cbba453fb83e4f5d6f261ecc, State: Running, Role: LEADER
02:04:08.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.918991  1225 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f4d3459cbba453fb83e4f5d6f261ecc in term 1.
02:04:08.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.920796  1609 consensus_queue.cc:237] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:08.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:08.943267   729 catalog_manager.cc:5719] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131). New cstate: current_term: 1 leader_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } health_report { overall_health: UNKNOWN } } }
02:04:09.355 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 8b8465bb472c4856835ebcedd5e64898
02:04:09.377 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:09.384 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:09.385 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [10ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: OK, deferred=null) after lookup
02:04:09.396 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:09.400 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] Successfully connected to peer
02:04:09.486 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0xbf649454, L:/127.0.0.1:59800 - R:/127.0.101.131:33449] using TOKEN/null
02:04:09.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:09.494695  1640 consensus_queue.cc:1048] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [LEADER]: Connected to new peer: Peer: permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:09.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:09.496754  1637 consensus_queue.cc:1048] T 81e55b831d044bf79df32a98e67747fd P 9f4d3459cbba453fb83e4f5d6f261ecc [LEADER]: Connected to new peer: Peer: permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:09.917 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=81e55b831d044bf79df32a98e67747fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:09.920 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.0.101.188:36233
02:04:09.921 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:04:09.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:09.923120   406 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 657
02:04:09.980 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.0.101.188:36233(127.0.101.188:36233)] handling channelInactive
02:04:09.981 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state READY due to: connection closed
02:04:09.987 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:09.988 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.0.101.131:33449
02:04:09.989 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

02:04:09.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:09.989694   406 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 1311
02:04:10.039 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] handling channelInactive
02:04:10.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state READY due to: connection closed
02:04:10.040 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:10.041 [DEBUG - Time-limited test] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:10.043 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:10.044 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:10.044 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:10.062 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.065 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.065 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.065 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.0.101.188:36233(127.0.101.188:36233) for tablet Kudu Master: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.083 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.086 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.086 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.086 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.090 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.103 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.106 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.107 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.107 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.108 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.123 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.124 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.124 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.125 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.127 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.143 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.144 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.145 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.145 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.147 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.184 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.186 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.186 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.186 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.189 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.203 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.205 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.205 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.206 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.207 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.323 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.325 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.325 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.325 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.328 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.423 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.425 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.426 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.427 [INFO - pool-2-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.427 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:10.637382  1303 heartbeater.cc:646] Failed to heartbeat to 127.0.101.188:36233 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:04:10.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:10.637626  1082 heartbeater.cc:646] Failed to heartbeat to 127.0.101.188:36233 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:04:10.783 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:10.784 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.785 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.785 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:10.786 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233; will retry
02:04:10.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:10.929316  1673 raft_consensus.cc:493] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d025a483a65e476ca39bae97f97ec77e)
02:04:10.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:10.931591  1673 raft_consensus.cc:515] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:04:10.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:10.935505  1673 leader_election.cc:290] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9869ac4f8ae44d48c352052a2d402a7 (127.0.101.189:37875), d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233)
02:04:10.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:10.936713   611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "003ff09a61864c199474cbbd2470d0fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d9869ac4f8ae44d48c352052a2d402a7" is_pre_election: true
02:04:10.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:10.939278   457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111) [suppressed 13 similar messages]
02:04:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:10.943640   457 leader_election.cc:336] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233): Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:04:10.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:10.944164   457 leader_election.cc:304] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 003ff09a61864c199474cbbd2470d0fb; no voters: d025a483a65e476ca39bae97f97ec77e, d9869ac4f8ae44d48c352052a2d402a7
02:04:10.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:10.944913  1673 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:04:11.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.042568  1676 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d025a483a65e476ca39bae97f97ec77e)
02:04:11.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.043215  1676 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:04:11.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.046562  1676 leader_election.cc:290] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 003ff09a61864c199474cbbd2470d0fb (127.0.101.190:43693), d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233)
02:04:11.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.047935   498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9869ac4f8ae44d48c352052a2d402a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "003ff09a61864c199474cbbd2470d0fb" is_pre_election: true
02:04:11.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.048736   498 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9869ac4f8ae44d48c352052a2d402a7 in term 1.
02:04:11.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.049448   576 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111) [suppressed 6 similar messages]
02:04:11.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.051160   576 leader_election.cc:304] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 003ff09a61864c199474cbbd2470d0fb, d9869ac4f8ae44d48c352052a2d402a7; no voters: 
02:04:11.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.052093  1676 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:11.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.052474  1676 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d025a483a65e476ca39bae97f97ec77e)
02:04:11.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.052870  1676 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 1 FOLLOWER]: Advancing to term 2
02:04:11.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.054270   576 leader_election.cc:336] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233): Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:04:11.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.061475  1676 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:04:11.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.063499  1676 leader_election.cc:290] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [CANDIDATE]: Term 2 election: Requested vote from peers 003ff09a61864c199474cbbd2470d0fb (127.0.101.190:43693), d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233)
02:04:11.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.064427   498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9869ac4f8ae44d48c352052a2d402a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "003ff09a61864c199474cbbd2470d0fb"
02:04:11.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.064878   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 1 FOLLOWER]: Advancing to term 2
02:04:11.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.068420   576 leader_election.cc:336] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233): Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111)
02:04:11.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.072901   498 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9869ac4f8ae44d48c352052a2d402a7 in term 2.
02:04:11.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.074263   576 leader_election.cc:304] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 003ff09a61864c199474cbbd2470d0fb, d9869ac4f8ae44d48c352052a2d402a7; no voters: d025a483a65e476ca39bae97f97ec77e
02:04:11.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.074978  1676 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 2 FOLLOWER]: Leader election won for term 2
02:04:11.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.076256  1676 raft_consensus.cc:697] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [term 2 LEADER]: Becoming Leader. State: Replica: d9869ac4f8ae44d48c352052a2d402a7, State: Running, Role: LEADER
02:04:11.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.077247  1676 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } }
02:04:11.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.082926  1681 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9869ac4f8ae44d48c352052a2d402a7. Latest consensus state: current_term: 2 leader_uuid: "d9869ac4f8ae44d48c352052a2d402a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:04:11.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.083758  1681 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: This master's current role is: LEADER
02:04:11.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.086081  1687 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:04:11.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.094949  1687 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898]
02:04:11.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.101667  1687 tablet_loader.cc:96] loaded metadata for tablet 81e55b831d044bf79df32a98e67747fd (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898])
02:04:11.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.103178  1687 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:04:11.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.106951  1687 catalog_manager.cc:1295] Loaded cluster ID: 9e37ac7618a342d6b90fcdfea4ad40c6
02:04:11.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.107364  1687 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:04:11.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.111163  1687 catalog_manager.cc:1540] Loading token signing keys...
02:04:11.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.114387  1687 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: Loaded TSK: 0
02:04:11.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.116209  1687 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:04:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.348475  1688 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f4d3459cbba453fb83e4f5d6f261ecc)
02:04:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.349013  1694 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f4d3459cbba453fb83e4f5d6f261ecc)
02:04:11.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.348974  1688 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:11.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.349517  1694 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:11.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.352591  1688 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683), 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:11.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.359012  1694 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449), 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:11.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.367288   914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:11.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.374723  1138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:11.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.374804   914 leader_election.cc:336] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:11.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.378261  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "16986928e6614ee6a68f08ba9012e42e" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" is_pre_election: true
02:04:11.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.378839  1225 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16986928e6614ee6a68f08ba9012e42e in term 1.
02:04:11.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.379494  1010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "16986928e6614ee6a68f08ba9012e42e" is_pre_election: true
02:04:11.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.380209  1010 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 794d4b8244cc430982b3b3e14eb8bcf3 in term 1.
02:04:11.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.380759   913 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e, 794d4b8244cc430982b3b3e14eb8bcf3; no voters: 9f4d3459cbba453fb83e4f5d6f261ecc
02:04:11.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.382125  1694 raft_consensus.cc:2804] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:11.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.382133  1138 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e, 794d4b8244cc430982b3b3e14eb8bcf3; no voters: 
02:04:11.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.382488  1694 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f4d3459cbba453fb83e4f5d6f261ecc)
02:04:11.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.382856  1694 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 1 FOLLOWER]: Advancing to term 2
02:04:11.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.383018  1688 raft_consensus.cc:2804] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:11.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.383383  1688 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f4d3459cbba453fb83e4f5d6f261ecc)
02:04:11.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.383709  1138 leader_election.cc:336] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.383746  1688 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 1 FOLLOWER]: Advancing to term 2
02:04:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.391149  1694 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.391584  1688 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:11.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.393842  1688 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 2 election: Requested vote from peers 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683), 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:11.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.394676  1010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "16986928e6614ee6a68f08ba9012e42e"
02:04:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.395515  1010 raft_consensus.cc:2393] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 794d4b8244cc430982b3b3e14eb8bcf3 in current term 2: Already voted for candidate 16986928e6614ee6a68f08ba9012e42e in this term.
02:04:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.399677  1138 leader_election.cc:336] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.399830   914 leader_election.cc:336] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.400174  1138 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 794d4b8244cc430982b3b3e14eb8bcf3; no voters: 16986928e6614ee6a68f08ba9012e42e, 9f4d3459cbba453fb83e4f5d6f261ecc
02:04:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.400979  1688 raft_consensus.cc:2749] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
02:04:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.401314  1694 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [CANDIDATE]: Term 2 election: Requested vote from peers 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449), 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825)
02:04:11.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.401957  1225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "16986928e6614ee6a68f08ba9012e42e" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "794d4b8244cc430982b3b3e14eb8bcf3"
02:04:11.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.402581  1225 raft_consensus.cc:2393] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 16986928e6614ee6a68f08ba9012e42e in current term 2: Already voted for candidate 794d4b8244cc430982b3b3e14eb8bcf3 in this term.
02:04:11.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.403652   913 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e; no voters: 794d4b8244cc430982b3b3e14eb8bcf3, 9f4d3459cbba453fb83e4f5d6f261ecc
02:04:11.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.405239  1694 raft_consensus.cc:2749] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
02:04:11.483 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.0.101.188:36233(127.0.101.188:36233)] connecting to peer
02:04:11.486 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:11.486 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.0.101.188:36233(127.0.101.188:36233)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:11.486 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.0.101.188:36233: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233
02:04:11.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:11.489125   576 consensus_peers.cc:597] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 -> Peer d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233): Couldn't send request to peer d025a483a65e476ca39bae97f97ec77e. Status: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:11.491 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:11.493 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29979, elapsed=1429), Traces: [0ms] sending RPC to server master-127.0.101.188:36233, [3ms] received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [24ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [28ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [45ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [46ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [63ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [64ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [65ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [83ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [85ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [124ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [125ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [127ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [127ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [143ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [145ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [145ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [145ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [263ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [265ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [266ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [266ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [364ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [365ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [365ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [365ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [719ms] refreshing cache from master, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [723ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [724ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [724ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [724ms] delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1419ms] refreshing cache from master, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1420ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1421ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1424ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1425ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1428ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, deferred=Deferred@1824603982(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@77859775 after retry RPC after error@1207962287) -> (continuation of Deferred@241231675 after retry RPC after error@1799262966) -> (continuation of Deferred@1340315101 after retry RPC after error@125746172) -> (continuation of Deferred@237948183 after retry RPC after error@286807814) -> (continuation of Deferred@1107715461 after retry RPC after error@819304290) -> (continuation of Deferred@1215013402 after retry RPC after error@454589558) -> (continuation of Deferred@1782782173 after retry RPC after error@1991375984) -> (continuation of Deferred@1667230670 after retry RPC after error@998035487) -> (continuation of Deferred@1233891933 after retry RPC after error@815826272), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@77859775 after retry RPC after error@1207962287) -> (continuation of Deferred@241231675 after retry RPC after error@1799262966) -> (continuation of Deferred@1340315101 after retry RPC after error@125746172) -> (continuation of Deferred@237948183 after retry RPC after error@286807814) -> (continuation of Deferred@1107715461 after retry RPC after error@819304290) -> (continuation of Deferred@1215013402 after retry RPC after error@454589558) -> (continuation of Deferred@1782782173 after retry RPC after error@1991375984) -> (continuation of Deferred@1667230670 after retry RPC after error@998035487) -> (continuation of Deferred@1233891933 after retry RPC after error@815826272))) after lookup
02:04:11.500 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:11.500 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:11.503 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1460), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test)) after lookup
02:04:11.506 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:11.508 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.509 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.509 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.504509   498 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [term 2 FOLLOWER]: Refusing update from remote peer d9869ac4f8ae44d48c352052a2d402a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:04:11.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.506544  1681 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
02:04:11.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.513691  1708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9869ac4f8ae44d48c352052a2d402a7. Latest consensus state: current_term: 2 leader_uuid: "d9869ac4f8ae44d48c352052a2d402a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:04:11.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.514583  1708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: This master's current role is: FOLLOWER
02:04:11.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.520483  1681 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "d9869ac4f8ae44d48c352052a2d402a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:04:11.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.521658  1681 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 [sys.catalog]: This master's current role is: LEADER
02:04:11.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.525034  1708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "d9869ac4f8ae44d48c352052a2d402a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "003ff09a61864c199474cbbd2470d0fb" member_type: VOTER last_known_addr { host: "127.0.101.190" port: 43693 } } peers { permanent_uuid: "d9869ac4f8ae44d48c352052a2d402a7" member_type: VOTER last_known_addr { host: "127.0.101.189" port: 37875 } } peers { permanent_uuid: "d025a483a65e476ca39bae97f97ec77e" member_type: VOTER last_known_addr { host: "127.0.101.188" port: 36233 } } }
02:04:11.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:11.526224  1708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 003ff09a61864c199474cbbd2470d0fb [sys.catalog]: This master's current role is: FOLLOWER
02:04:11.532 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:11.533 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:11.534 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1493), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1465ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1469ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1469ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1483ms] refreshing cache from master, [1483ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1492ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175))) after lookup
02:04:11.536 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:11.537 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.537 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.538 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.567 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:11.568 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:11.569 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1528), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1465ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1469ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1469ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1483ms] refreshing cache from master, [1483ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1492ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1495ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1498ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1498ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1522ms] refreshing cache from master, [1522ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1527ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527))) after lookup
02:04:11.570 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:11.571 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.571 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.571 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.707 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:11.707 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:11.708 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1667), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1465ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1469ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1469ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1483ms] refreshing cache from master, [1483ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1492ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1495ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1498ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1498ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1522ms] refreshing cache from master, [1522ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1527ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1529ms] too many traces: truncated at 100 traces, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200))) after lookup
02:04:11.709 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:11.711 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.711 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:11.711 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:12.028 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:12.028 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:12.030 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1988), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1465ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1469ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1469ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1483ms] refreshing cache from master, [1483ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1492ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1495ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1498ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1498ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1522ms] refreshing cache from master, [1522ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1527ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1529ms] too many traces: truncated at 100 traces, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200) -> (continuation of Deferred@203822328 after retry RPC@623589660), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200) -> (continuation of Deferred@203822328 after retry RPC@623589660))) after lookup
02:04:12.031 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:12.033 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:12.033 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:12.033 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:12.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:12.588323  1084 heartbeater.cc:499] Master 127.0.101.189:37875 was elected leader, sending a full tablet report...
02:04:12.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:12.642881  1304 heartbeater.cc:499] Master 127.0.101.189:37875 was elected leader, sending a full tablet report...
02:04:12.867 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:12.868 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825),9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)[L]]}]
02:04:12.868 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2828), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1465ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1469ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1469ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1483ms] refreshing cache from master, [1483ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1492ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1495ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1498ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1498ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1522ms] refreshing cache from master, [1522ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1527ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1529ms] too many traces: truncated at 100 traces, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200) -> (continuation of Deferred@203822328 after retry RPC@623589660) -> (continuation of Deferred@1060984201 after retry RPC@1126332587), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200) -> (continuation of Deferred@203822328 after retry RPC@623589660) -> (continuation of Deferred@1060984201 after retry RPC@1126332587))) after lookup
02:04:12.874 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] connecting to peer
02:04:12.876 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:12.876 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] cleaning up while in state CONNECTING due to: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:12.876 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449) for tablet 81e55b831d044bf79df32a98e67747fd: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449
02:04:13.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.404732  1729 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:13.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.405494  1729 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:13.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.407969  1729 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683), 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.409438  1010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "16986928e6614ee6a68f08ba9012e42e" is_pre_election: true
02:04:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.410151  1010 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 794d4b8244cc430982b3b3e14eb8bcf3 in term 2.
02:04:13.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.411516  1138 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e, 794d4b8244cc430982b3b3e14eb8bcf3; no voters: 
02:04:13.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.412406  1729 raft_consensus.cc:2804] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Leader pre-election won for term 3
02:04:13.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.412681  1729 raft_consensus.cc:493] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.412884  1729 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 2 FOLLOWER]: Advancing to term 3
02:04:13.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:13.416051  1138 leader_election.cc:336] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:13.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.419288  1729 raft_consensus.cc:515] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:13.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.421093  1729 leader_election.cc:290] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 3 election: Requested vote from peers 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683), 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449)
02:04:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.422075  1010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81e55b831d044bf79df32a98e67747fd" candidate_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "16986928e6614ee6a68f08ba9012e42e"
02:04:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.422510  1010 raft_consensus.cc:3060] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 2 FOLLOWER]: Advancing to term 3
02:04:13.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:13.425721  1138 leader_election.cc:336] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:13.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.429423  1010 raft_consensus.cc:2468] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 794d4b8244cc430982b3b3e14eb8bcf3 in term 3.
02:04:13.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.430948  1138 leader_election.cc:304] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16986928e6614ee6a68f08ba9012e42e, 794d4b8244cc430982b3b3e14eb8bcf3; no voters: 9f4d3459cbba453fb83e4f5d6f261ecc
02:04:13.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.431913  1729 raft_consensus.cc:2804] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 3 FOLLOWER]: Leader election won for term 3
02:04:13.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.433387  1729 raft_consensus.cc:697] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 3 LEADER]: Becoming Leader. State: Replica: 794d4b8244cc430982b3b3e14eb8bcf3, State: Running, Role: LEADER
02:04:13.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.434691  1729 consensus_queue.cc:237] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } }
02:04:13.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.447597   596 catalog_manager.cc:5719] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 reported cstate change: term changed from 1 to 3, leader changed from 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131) to 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130). New cstate: current_term: 3 leader_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f4d3459cbba453fb83e4f5d6f261ecc" member_type: VOTER last_known_addr { host: "127.0.101.131" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "794d4b8244cc430982b3b3e14eb8bcf3" member_type: VOTER last_known_addr { host: "127.0.101.130" port: 33825 } health_report { overall_health: HEALTHY } } }
02:04:13.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:13.878424  1138 consensus_peers.cc:597] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 -> Peer 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): Couldn't send request to peer 9f4d3459cbba453fb83e4f5d6f261ecc. Status: Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:13.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.966929  1010 raft_consensus.cc:1275] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 3 FOLLOWER]: Refusing update from remote peer 794d4b8244cc430982b3b3e14eb8bcf3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
02:04:13.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:13.969470  1729 consensus_queue.cc:1048] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16986928e6614ee6a68f08ba9012e42e" member_type: VOTER last_known_addr { host: "127.0.101.129" port: 44683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
02:04:14.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:14.002789   576 consensus_peers.cc:597] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7 -> Peer d025a483a65e476ca39bae97f97ec77e (127.0.101.188:36233): Couldn't send request to peer d025a483a65e476ca39bae97f97ec77e. Status: Network error: Client connection negotiation failed: client connection to 127.0.101.188:36233: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
02:04:14.249 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 81e55b831d044bf79df32a98e67747fd for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:14.250 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=81e55b831d044bf79df32a98e67747fd@[16986928e6614ee6a68f08ba9012e42e(127.0.101.129:44683),794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825)[L],9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)]}]
02:04:14.251 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=81e55b831d044bf79df32a98e67747fd, attempt=14, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=4210), Traces: [0ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [4ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [4ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [21ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [42ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [43ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [46ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [50ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [68ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [85ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [86ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [87ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [87ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [103ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [105ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [144ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [146ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [147ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [149ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [149ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [162ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [163ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [165ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [167ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [167ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [282ms] Sub RPC GetTableLocations: refreshing cache from master, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [283ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [285ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [287ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [288ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [288ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [382ms] Sub RPC GetTableLocations: refreshing cache from master, [382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [386ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [387ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [387ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [743ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [745ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [746ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.0.101.190:43693,127.0.101.189:37875,127.0.101.188:36233) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1441ms] Sub RPC GetTableLocations: refreshing cache from master, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.190:43693, [1442ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.189:37875, [1443ms] Sub RPC ConnectToMaster: sending RPC to server master-127.0.101.188:36233, [1446ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.188:36233: Network error: Failed to connect to peer master-127.0.101.188:36233(127.0.101.188:36233): Connection refused: /127.0.101.188:36233, [1447ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.190:43693: OK, [1450ms] Sub RPC ConnectToMaster: received response from server master-127.0.101.189:37875: OK, [1454ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1459ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1465ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1469ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1469ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1483ms] refreshing cache from master, [1483ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1492ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1495ms] sending RPC to server 9f4d3459cbba453fb83e4f5d6f261ecc, [1498ms] received response from server 9f4d3459cbba453fb83e4f5d6f261ecc: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1498ms] delaying RPC due to: Network error: Failed to connect to peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449): Connection refused: /127.0.101.131:33449, [1522ms] refreshing cache from master, [1522ms] Sub RPC GetTableLocations: sending RPC to server master-127.0.101.189:37875, [1527ms] Sub RPC GetTableLocations: received response from server master-127.0.101.189:37875: OK, [1529ms] too many traces: truncated at 100 traces, deferred=Deferred@1906104465(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@651195a5 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200) -> (continuation of Deferred@203822328 after retry RPC@623589660) -> (continuation of Deferred@1060984201 after retry RPC@1126332587) -> (continuation of Deferred@1669172573 after retry RPC@868894393), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@512e87e2 -> wakeup thread Time-limited test -> (continuation of Deferred@1824603982 after retry RPC@1803871175) -> (continuation of Deferred@548287553 after retry RPC@1402411527) -> (continuation of Deferred@2085331668 after retry RPC@401070200) -> (continuation of Deferred@203822328 after retry RPC@623589660) -> (continuation of Deferred@1060984201 after retry RPC@1126332587) -> (continuation of Deferred@1669172573 after retry RPC@868894393))) after lookup
02:04:14.252 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825)] connecting to peer
02:04:14.253 [DEBUG - kudu-nio-6] (Connection.java:757) [peer 794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825)] Successfully connected to peer
02:04:14.296 [DEBUG - kudu-nio-6] (Negotiator.java:918) Authenticated connection [id: 0x32ad2c02, L:/127.0.0.1:41106 - R:/127.0.101.130:33825] using TOKEN/null
02:04:14.549 [DEBUG - kudu-nio-6] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=81e55b831d044bf79df32a98e67747fd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:14.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.556391   594 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54908:
02:04:14.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
02:04:14.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.557214   594 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54908:
02:04:14.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
02:04:14.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.588406   594 catalog_manager.cc:6006] T 00000000000000000000000000000000 P d9869ac4f8ae44d48c352052a2d402a7: Sending DeleteTablet for 3 replicas of tablet 81e55b831d044bf79df32a98e67747fd
02:04:14.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:14.629498   577 catalog_manager.cc:4777] TS 9f4d3459cbba453fb83e4f5d6f261ecc (127.0.101.131:33449): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 81e55b831d044bf79df32a98e67747fd: Network error: Client connection negotiation failed: client connection to 127.0.101.131:33449: connect: Connection refused (error 111)
02:04:14.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.637588   980 tablet_service.cc:1558] Processing DeleteTablet for tablet 81e55b831d044bf79df32a98e67747fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:04:14 UTC) from {username='slave'} at 127.0.0.1:47976
02:04:14.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.643249  1201 tablet_service.cc:1558] Processing DeleteTablet for tablet 81e55b831d044bf79df32a98e67747fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:04:14 UTC) from {username='slave'} at 127.0.0.1:41118
02:04:14.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.643699  1785 tablet_replica.cc:333] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: stopping tablet replica
02:04:14.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.644594  1785 raft_consensus.cc:2243] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 3 FOLLOWER]: Raft consensus shutting down.
02:04:14.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.646003  1785 raft_consensus.cc:2272] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e [term 3 FOLLOWER]: Raft consensus is shut down!
02:04:14.647 [DEBUG - main] (Connection.java:575) [peer master-127.0.101.189:37875(127.0.101.189:37875)] disconnecting while in state READY
02:04:14.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.650995  1785 ts_tablet_manager.cc:1916] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Deleting tablet data with delete state TABLET_DATA_DELETED
02:04:14.657 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.0.101.189:37875(127.0.101.189:37875)] handling channelInactive
02:04:14.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.659246  1787 tablet_replica.cc:333] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: stopping tablet replica
02:04:14.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.660686  1787 raft_consensus.cc:2243] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 3 LEADER]: Raft consensus shutting down.
02:04:14.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.662760  1787 raft_consensus.cc:2272] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3 [term 3 FOLLOWER]: Raft consensus is shut down!
02:04:14.666 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.0.101.189:37875(127.0.101.189:37875)] cleaning up while in state READY due to: connection closed
02:04:14.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.667207  1787 ts_tablet_manager.cc:1916] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Deleting tablet data with delete state TABLET_DATA_DELETED
02:04:14.667 [DEBUG - main] (Connection.java:575) [peer 794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825)] disconnecting while in state READY
02:04:14.670 [DEBUG - kudu-nio-6] (Connection.java:239) [peer 794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825)] handling channelInactive
02:04:14.670 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 794d4b8244cc430982b3b3e14eb8bcf3(127.0.101.130:33825)] cleaning up while in state READY due to: connection closed
02:04:14.671 [DEBUG - main] (Connection.java:575) [peer master-127.0.101.188:36233(127.0.101.188:36233)] disconnecting while in state TERMINATED
02:04:14.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.670862  1785 ts_tablet_manager.cc:1929] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.22
02:04:14.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.671360  1785 log.cc:1199] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Deleting WAL directory at /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-0/wal/wals/81e55b831d044bf79df32a98e67747fd
02:04:14.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.672325  1785 ts_tablet_manager.cc:1950] T 81e55b831d044bf79df32a98e67747fd P 16986928e6614ee6a68f08ba9012e42e: Deleting consensus metadata
02:04:14.673 [DEBUG - main] (Connection.java:575) [peer master-127.0.101.190:43693(127.0.101.190:43693)] disconnecting while in state READY
02:04:14.674 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.0.101.190:43693(127.0.101.190:43693)] handling channelInactive
02:04:14.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.0.101.190:43693(127.0.101.190:43693)] cleaning up while in state READY due to: connection closed
02:04:14.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.676156   577 catalog_manager.cc:5050] TS 16986928e6614ee6a68f08ba9012e42e (127.0.101.129:44683): tablet 81e55b831d044bf79df32a98e67747fd (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898]) successfully deleted
02:04:14.676 [DEBUG - main] (Connection.java:575) [peer 9f4d3459cbba453fb83e4f5d6f261ecc(127.0.101.131:33449)] disconnecting while in state TERMINATED
02:04:14.679 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:04:14.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.685302   406 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 856
02:04:14.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.700335  1787 ts_tablet_manager.cc:1929] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.22
02:04:14.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.701175  1787 log.cc:1199] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Deleting WAL directory at /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster3631908468563514512/ts-1/wal/wals/81e55b831d044bf79df32a98e67747fd
02:04:14.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.703039  1787 ts_tablet_manager.cc:1950] T 81e55b831d044bf79df32a98e67747fd P 794d4b8244cc430982b3b3e14eb8bcf3: Deleting consensus metadata
02:04:14.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.708694   576 catalog_manager.cc:5050] TS 794d4b8244cc430982b3b3e14eb8bcf3 (127.0.101.130:33825): tablet 81e55b831d044bf79df32a98e67747fd (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8b8465bb472c4856835ebcedd5e64898]) successfully deleted
02:04:14.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.748662   406 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 1090
02:04:14.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.793310   406 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 421
02:04:14.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:14.836649   406 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 541
02:04:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T02:04:16Z chronyd exiting
.02:04:17.411 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1786500257411
02:04:17.417 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:04:17.418 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:04:17.418 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskyzaRjo/test-tmp
02:04:17.418 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:04:17.419 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskyzaRjo/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:04:17.423 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:04:17.815 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:17.815 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:04:17.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:17.819769  1795 mini_oidc.cc:150] Starting JWKS server
02:04:17.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:17.823679  1795 webserver.cc:533] Webserver started at http://127.0.0.1:38015/ using document root <none> and password file <none>
02:04:17.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:17.824224  1795 mini_oidc.cc:186] Starting OIDC Discovery server
02:04:17.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:17.826390  1795 webserver.cc:533] Webserver started at http://127.0.0.1:41757/ using document root <none> and password file <none>
02:04:17.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T02:04:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:04:17.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T02:04:17Z Disabled control of system clock
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:17.906886  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:17.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/logs
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data/info.pb
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.254:36703
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.254
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json with env {}
02:04:18.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.288360  1813 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:18.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.288959  1813 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:18.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.289436  1813 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:18.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.327136  1813 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:18.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.327488  1813 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:18.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.327694  1813 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:18.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.327898  1813 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:18.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.328121  1813 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:18.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.328286  1813 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38015/jwks.json
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:18.369843  1813 master_runner.cc:387] Master server non-default flags:
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/logs
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.254:36703
02:04:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data/info.pb
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.254
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:18.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:18.371304  1813 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:18.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:18.373283  1813 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:18.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.387100  1823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:19.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.391357  1827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:19.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:18.388206  1824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:19.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:19.679577  1825 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1287 milliseconds
02:04:19.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.679729  1813 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:19.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.682442  1813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.690560  1813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:19.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.692523  1813 hybrid_clock.cc:648] HybridClock initialized: now 1786500259692501 us; error 93 us; skew 500 ppm
02:04:19.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.693744  1813 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.701339  1813 webserver.cc:533] Webserver started at http://127.1.192.254:42071/ using document root <none> and password file <none>
02:04:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.702466  1813 fs_manager.cc:362] Metadata directory not provided
02:04:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.702709  1813 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.703162  1813 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:19.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.708232  1813 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data/instance:
02:04:19.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d088d790f86488f9628cb481fbe54fe"
02:04:19.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:19 on dist-test-slave-kvfs"
02:04:19.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.709538  1813 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal/instance:
02:04:19.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d088d790f86488f9628cb481fbe54fe"
02:04:19.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:19 on dist-test-slave-kvfs"
02:04:19.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.718327  1813 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
02:04:19.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.725932  1839 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:19.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.727510  1813 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.727885  1813 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3d088d790f86488f9628cb481fbe54fe"
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:19 on dist-test-slave-kvfs"
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.728320  1813 fs_report.cc:389] FS layout report
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal
02:04:19.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data/data
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:19.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:19.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.786613  1813 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:19.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.788378  1813 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:19.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.788831  1813 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.874270  1813 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.254:36703
02:04:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.874372  1917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.254:36703 every 8 connection(s)
02:04:19.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.877318  1813 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/data/info.pb
02:04:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.885319  1922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.886469  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 1813
02:04:19.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.887049  1795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-0/wal/instance
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.890766  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/logs
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data/info.pb
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:19.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.253:44361
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.253
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:19.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:19.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:19.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:19.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json with env {}
02:04:19.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.897941  1922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } has no permanent_uuid. Determining permanent_uuid...
02:04:19.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:19.940973  1922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } has no permanent_uuid. Determining permanent_uuid...
02:04:19.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:19.944545  1844 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:19.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:19.950826  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:20.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.000587  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 1
02:04:20.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.007599  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.076252  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 2
02:04:20.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.083032  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:20.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.174562  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 3
02:04:20.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.180469  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:20.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.280973  1927 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:20.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.281577  1927 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:20.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.282051  1927 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:20.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.319517  1927 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:20.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.319955  1927 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:20.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.320263  1927 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:20.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.320472  1927 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:20.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.320673  1927 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:20.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.320845  1927 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38015/jwks.json
02:04:20.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.324100  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 4
02:04:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.328761  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:20.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.363098  1927 master_runner.cc:387] Master server non-default flags:
02:04:20.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/logs
02:04:20.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:20.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.253:44361
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data/info.pb
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.253
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.365116  1927 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:20.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.367297  1927 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:20.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.379575  1938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:20.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:20.628321  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 5
02:04:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.640751  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:21.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.188376  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 6
02:04:21.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:21.222806  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.253:44361: Network error: Client connection negotiation failed: client connection to 127.1.192.253:44361: connect: Connection refused (error 111)
02:04:21.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:21.785948  1937 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee00 after lost signal to thread 1927
02:04:21.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:21.922616  1927 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.542s	user 0.530s	sys 1.006s
02:04:21.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:21.923213  1927 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.543s	user 0.530s	sys 1.006s
02:04:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:20.381657  1940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:21.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:21.924710  1941 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1542 milliseconds
02:04:21.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:21.925328  1943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:21.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.925257  1927 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:21.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.931660  1927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.934808  1927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.936371  1927 hybrid_clock.cc:648] HybridClock initialized: now 1786500261936294 us; error 75 us; skew 500 ppm
02:04:21.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.937296  1927 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:21.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.945355  1927 webserver.cc:533] Webserver started at http://127.1.192.253:33017/ using document root <none> and password file <none>
02:04:21.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.946427  1927 fs_manager.cc:362] Metadata directory not provided
02:04:21.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.946661  1927 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:21.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.947098  1927 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:21.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.952847  1927 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data/instance:
02:04:21.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e937e81691c449c88f500f3395c86870"
02:04:21.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:21 on dist-test-slave-kvfs"
02:04:21.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.954206  1927 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal/instance:
02:04:21.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e937e81691c449c88f500f3395c86870"
02:04:21.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:21 on dist-test-slave-kvfs"
02:04:21.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.962860  1927 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.001s
02:04:21.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.969798  1954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:21.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.971565  1927 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
02:04:21.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.971925  1927 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal
02:04:21.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e937e81691c449c88f500f3395c86870"
02:04:21.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:21 on dist-test-slave-kvfs"
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:21.972332  1927 fs_report.cc:389] FS layout report
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data/data
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:22.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.041930  1927 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.044193  1927 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:22.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.044682  1927 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:22.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.131659  1927 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.253:44361
02:04:22.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.131726  2037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.253:44361 every 8 connection(s)
02:04:22.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.134490  1927 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/data/info.pb
02:04:22.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.139175  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 1927
02:04:22.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.139719  1795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-1/wal/instance
02:04:22.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.141621  2041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.142889  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/logs
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/info.pb
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:22.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.252:33993
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.252
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:22.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:22.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:22.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json with env {}
02:04:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.156565  2041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } has no permanent_uuid. Determining permanent_uuid...
02:04:22.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.187680  2041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } has no permanent_uuid. Determining permanent_uuid...
02:04:22.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.207394  2041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } has no permanent_uuid. Determining permanent_uuid...
02:04:22.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.210755  1958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.217566  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.267385  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 1
02:04:22.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.272802  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.283592  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } attempt: 7
02:04:22.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.298441  1922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } has no permanent_uuid. Determining permanent_uuid...
02:04:22.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.306257  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.341382  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 2
02:04:22.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.348338  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.364755  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 1
02:04:22.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.369665  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.439867  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 3
02:04:22.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.445729  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.451206  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 2
02:04:22.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.456140  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.541668  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 3
02:04:22.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.541668  2044 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:22.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.542507  2044 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:22.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.543076  2044 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:22.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.548077  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.586402  2044 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:22.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.586743  2044 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:22.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.586952  2044 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:22.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.587164  2044 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:22.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.587357  2044 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:22.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.587548  2044 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38015/jwks.json
02:04:22.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.589206  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 4
02:04:22.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.593945  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.638854  2044 master_runner.cc:387] Master server non-default flags:
02:04:22.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/logs
02:04:22.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:22.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.252:33993
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/info.pb
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.252
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:22.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:22.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.640997  2044 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:22.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.643498  2044 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:22.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.660187  2064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:22.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.688616  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 4
02:04:22.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.699283  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.893496  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 5
02:04:22.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.903934  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:22.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:22.983508  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 5
02:04:22.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.993467  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:23.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:23.451586  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 6
02:04:23.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:23.489889  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:23.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:23.546198  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 6
02:04:23.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:23.569273  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:24.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.550575  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 7
02:04:24.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.585553  2041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:24.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.602912  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 7
02:04:24.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.631924  1922 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.192.252:33993: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:24.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:22.660540  2065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:24.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.063292  2063 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee00 after lost signal to thread 2044
02:04:24.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.712720  2044 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.053s	user 0.765s	sys 1.277s
02:04:24.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.714857  2044 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.056s	user 0.766s	sys 1.277s
02:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.716684  2067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:24.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:24.721863  2066 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2052 milliseconds
02:04:24.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.722223  2044 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:24.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.723824  2044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:24.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.727517  2044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:24.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.729068  2044 hybrid_clock.cc:648] HybridClock initialized: now 1786500264729010 us; error 70 us; skew 500 ppm
02:04:24.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.730115  2044 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:24.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.738293  2044 webserver.cc:533] Webserver started at http://127.1.192.252:37577/ using document root <none> and password file <none>
02:04:24.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.739603  2044 fs_manager.cc:362] Metadata directory not provided
02:04:24.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.739913  2044 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:24.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.740602  2044 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:24.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.746613  2044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/instance:
02:04:24.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c928a15dfbbd441f8a335547334361d9"
02:04:24.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:24 on dist-test-slave-kvfs"
02:04:24.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.748600  2044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal/instance:
02:04:24.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c928a15dfbbd441f8a335547334361d9"
02:04:24.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:24 on dist-test-slave-kvfs"
02:04:24.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.757516  2044 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
02:04:24.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.767392  2094 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:24.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.769132  2044 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.001s	sys 0.005s
02:04:24.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.769624  2044 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:24.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c928a15dfbbd441f8a335547334361d9"
02:04:24.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:24 on dist-test-slave-kvfs"
02:04:24.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.770048  2044 fs_report.cc:389] FS layout report
02:04:24.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/data
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:24.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:24.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:24.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.849371  2044 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:24.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.851307  2044 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:24.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.851918  2044 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:24.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.987104  2044 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.252:33993
02:04:24.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.987206  2181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.252:33993 every 8 connection(s)
02:04:24.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.990407  2044 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/info.pb
02:04:24.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.997639  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 2044
02:04:24.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.998095  1795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal/instance
02:04:25.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:24.999852  2183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:25.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.022948  2183 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } has no permanent_uuid. Determining permanent_uuid...
02:04:25.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.069419  2183 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } has no permanent_uuid. Determining permanent_uuid...
02:04:25.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.088598  2183 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } has no permanent_uuid. Determining permanent_uuid...
02:04:25.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.110765  2183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Bootstrap starting.
02:04:25.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.124279  2183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Neither blocks nor log segments found. Creating new log.
02:04:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.127229  2183 log.cc:826] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Log is configured to *not* fsync() on all Append() calls
02:04:25.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.139102  2183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: No bootstrap required, opened a new log
02:04:25.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.166416  2183 raft_consensus.cc:359] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:25.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.167209  2183 raft_consensus.cc:385] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:25.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.167420  2183 raft_consensus.cc:740] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c928a15dfbbd441f8a335547334361d9, State: Initialized, Role: FOLLOWER
02:04:25.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.168356  2183 consensus_queue.cc:260] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:25.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.173978  2183 sys_catalog.cc:565] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: configured and running, proceeding with master startup.
02:04:25.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.173590  2198 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.176820  2198 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: FOLLOWER
02:04:25.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:25.218889  2213 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:25.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:25.219266  2213 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:25.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.213075  2044 master_runner.cc:187] Error getting master registration for 127.1.192.254:36703: OK, instance_id { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" instance_seqno: 1786500259852185 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:04:25.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.252496  2044 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:04:25.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:25.360450  2102 tablet.cc:2406] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:25.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.456760  2198 raft_consensus.cc:493] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:25.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.457744  2198 raft_consensus.cc:515] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:25.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:25.463635  2198 leader_election.cc:290] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d088d790f86488f9628cb481fbe54fe (127.1.192.254:36703), e937e81691c449c88f500f3395c86870 (127.1.192.253:44361)
02:04:26.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:26.224624  2213 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:26.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:26.225032  2213 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:26.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.676213  2041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 8
02:04:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.693554  1922 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } attempt: 8
02:04:26.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.726881  2041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: Bootstrap starting.
02:04:26.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.737993  2041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: Neither blocks nor log segments found. Creating new log.
02:04:26.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.740626  2041 log.cc:826] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: Log is configured to *not* fsync() on all Append() calls
02:04:26.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.745491  1922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: Bootstrap starting.
02:04:26.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.746670  2041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: No bootstrap required, opened a new log
02:04:26.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.762774  1922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: Neither blocks nor log segments found. Creating new log.
02:04:26.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.765513  1922 log.cc:826] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: Log is configured to *not* fsync() on all Append() calls
02:04:26.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.773237  1922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: No bootstrap required, opened a new log
02:04:26.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.779452  2041 raft_consensus.cc:359] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:26.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.780841  2041 raft_consensus.cc:385] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:26.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.781348  2041 raft_consensus.cc:740] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e937e81691c449c88f500f3395c86870, State: Initialized, Role: FOLLOWER
02:04:26.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.782759  2041 consensus_queue.cc:260] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:26.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.789849  2224 sys_catalog.cc:455] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:26.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.791680  2041 sys_catalog.cc:565] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: configured and running, proceeding with master startup.
02:04:26.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.797288  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c928a15dfbbd441f8a335547334361d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e937e81691c449c88f500f3395c86870" is_pre_election: true
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.799872  1995 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c928a15dfbbd441f8a335547334361d9 in term 0.
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.800699  1995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47810 (request call id 1) took 1338 ms. Trace:
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.801057  1995 rpcz_store.cc:276] 0812 02:04:25.462291 (+     0us) service_pool.cc:167] Inserting onto call queue
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:25.462448 (+   157us) service_pool.cc:224] Handling call
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:26.800625 (+1338177us) inbound_call.cc:177] Queueing success response
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:04:26.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.803699  2098 leader_election.cc:304] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c928a15dfbbd441f8a335547334361d9, e937e81691c449c88f500f3395c86870; no voters: 
02:04:26.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.798645  2224 sys_catalog.cc:458] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: This master's current role is: FOLLOWER
02:04:26.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:26.811832  1961 tablet.cc:2406] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:26.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.820703  2227 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:26.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.822574  2227 raft_consensus.cc:493] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:26.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.823496  1922 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.824065  2227 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 0 FOLLOWER]: Advancing to term 1
02:04:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.825388  1922 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:26.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.826285  1922 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d088d790f86488f9628cb481fbe54fe, State: Initialized, Role: FOLLOWER
02:04:26.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.828233  1922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:26.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.841168  1922 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: configured and running, proceeding with master startup.
02:04:26.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.842729  1881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c928a15dfbbd441f8a335547334361d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d088d790f86488f9628cb481fbe54fe" is_pre_election: true
02:04:26.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.844363  1881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c928a15dfbbd441f8a335547334361d9 in term 0.
02:04:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.845188  1881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48834 (request call id 2) took 1382 ms. Trace:
02:04:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.846289  1881 rpcz_store.cc:276] 0812 02:04:25.462622 (+     0us) service_pool.cc:167] Inserting onto call queue
02:04:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:25.462960 (+   338us) service_pool.cc:224] Handling call
02:04:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:26.845095 (+1382135us) inbound_call.cc:177] Queueing success response
02:04:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
02:04:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.847211  2227 raft_consensus.cc:515] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:26.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.851763  2233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:26.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.856590  2233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: This master's current role is: FOLLOWER
02:04:26.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.862428  1881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c928a15dfbbd441f8a335547334361d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d088d790f86488f9628cb481fbe54fe"
02:04:26.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.862994  1995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c928a15dfbbd441f8a335547334361d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e937e81691c449c88f500f3395c86870"
02:04:26.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.863302  1881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 0 FOLLOWER]: Advancing to term 1
02:04:26.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.863605  1995 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 0 FOLLOWER]: Advancing to term 1
02:04:26.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.872900  1995 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c928a15dfbbd441f8a335547334361d9 in term 1.
02:04:26.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.873770  2227 leader_election.cc:290] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3d088d790f86488f9628cb481fbe54fe (127.1.192.254:36703), e937e81691c449c88f500f3395c86870 (127.1.192.253:44361)
02:04:26.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.875756  1881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c928a15dfbbd441f8a335547334361d9 in term 1.
02:04:26.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.875715  2098 leader_election.cc:304] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c928a15dfbbd441f8a335547334361d9, e937e81691c449c88f500f3395c86870; no voters: 
02:04:26.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.876721  2227 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 1 FOLLOWER]: Leader election won for term 1
02:04:26.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.883901  2227 raft_consensus.cc:697] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 1 LEADER]: Becoming Leader. State: Replica: c928a15dfbbd441f8a335547334361d9, State: Running, Role: LEADER
02:04:26.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.885385  2227 consensus_queue.cc:237] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:26.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.904327  2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c928a15dfbbd441f8a335547334361d9. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:26.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.905203  2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: LEADER
02:04:26.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.930490  2256 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:04:26.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.941275  2256 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:04:26.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.967707  1995 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Refusing update from remote peer c928a15dfbbd441f8a335547334361d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:26.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.970557  2247 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:26.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.978912  2273 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:04:26.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:26.982589  2257 catalog_manager.cc:1594] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:26.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:26.982949  2257 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:27.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.007647  1881 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Refusing update from remote peer c928a15dfbbd441f8a335547334361d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:27.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.009832  2247 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:27.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:26.925468  1927 master_runner.cc:187] Error getting master registration for 127.1.192.254:36703: OK, instance_id { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" instance_seqno: 1786500259852185 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:04:27.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.045454  1927 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:04:27.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.058307  1849 tablet.cc:2406] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:27.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.059880  2233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader c928a15dfbbd441f8a335547334361d9. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:27.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.061748  2233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: This master's current role is: FOLLOWER
02:04:27.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.067950  2267 mvcc.cc:204] Tried to move back new op lower bound from 7317505093479284736 to 7317505093176958976. Current Snapshot: MvccSnapshot[applied={T|T < 7317505093479284736}]
02:04:27.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.084770  2227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:27.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.085783  2227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: LEADER
02:04:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.087286  2227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:27.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.088372  2227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: LEADER
02:04:27.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.091810  2233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:27.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.092749  2233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: This master's current role is: FOLLOWER
02:04:27.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.096312  2256 catalog_manager.cc:1383] Generated new cluster ID: 6ce2fa453b274f21906ca6bc76abeacd
02:04:27.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.096861  2256 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:04:27.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.110265  2224 sys_catalog.cc:455] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c928a15dfbbd441f8a335547334361d9. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:27.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.119835  2224 sys_catalog.cc:458] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: This master's current role is: FOLLOWER
02:04:27.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.106674  2280 sys_catalog.cc:455] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c928a15dfbbd441f8a335547334361d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:27.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.123201  2280 sys_catalog.cc:458] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: This master's current role is: FOLLOWER
02:04:27.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.260286  2256 catalog_manager.cc:1406] Generated new certificate authority record
02:04:27.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.262655  2256 catalog_manager.cc:1540] Loading token signing keys...
02:04:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.315804  2256 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Generated new TSK 0
02:04:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.317736  2256 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:04:27.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.369880  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/logs
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data/info.pb
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:27.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.193:0
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.192.193
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.193
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:27.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:27.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.796530  2288 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:27.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.797606  2288 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:27.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.798241  2288 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:27.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.843672  2288 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:27.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.845731  2288 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.192.193
02:04:27.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.911274  2288 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/logs
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.193:0
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data/info.pb
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.193
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:27.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.192.193
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:27.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:27.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:27.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.914685  2288 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.917260  2288 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:27.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.968770  2296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:27.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.988945  2257 catalog_manager.cc:1295] Loaded cluster ID: 6ce2fa453b274f21906ca6bc76abeacd
02:04:27.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.989791  2257 catalog_manager.cc:1588] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: loading cluster ID for follower catalog manager: success
02:04:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:27.998128  2257 catalog_manager.cc:1610] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: acquiring CA information for follower catalog manager: success
02:04:28.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:28.014541  2257 catalog_manager.cc:1638] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:28.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:28.021426  2273 catalog_manager.cc:1295] Loaded cluster ID: 6ce2fa453b274f21906ca6bc76abeacd
02:04:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:28.028174  2273 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: loading cluster ID for follower catalog manager: success
02:04:28.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:28.068742  2273 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: acquiring CA information for follower catalog manager: success
02:04:28.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:28.083033  2273 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:29.363314  2295 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 2288
02:04:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:30.089473  2295 kernel_stack_watchdog.cc:198] Thread 2288 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 389ms:
02:04:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:30.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:30.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:30.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:30.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:27.975402  2298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:30.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:30.090962  2288 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.119s	user 0.701s	sys 1.145s
02:04:30.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:30.091353  2288 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.119s	user 0.701s	sys 1.145s
02:04:30.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.104667  2288 server_base.cc:1061] running on GCE node
02:04:30.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:30.105708  2309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:30.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.107702  2288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:30.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.110903  2288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:30.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.112432  2288 hybrid_clock.cc:648] HybridClock initialized: now 1786500270112272 us; error 188 us; skew 500 ppm
02:04:30.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.113637  2288 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:30.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.123132  2288 webserver.cc:533] Webserver started at http://127.1.192.193:39065/ using document root <none> and password file <none>
02:04:30.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.124544  2288 fs_manager.cc:362] Metadata directory not provided
02:04:30.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.124863  2288 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:30.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.126348  2288 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:30.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.133313  2288 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data/instance:
02:04:30.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "57a860cab3274fad98ff833ef6c38fb5"
02:04:30.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:30 on dist-test-slave-kvfs"
02:04:30.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.134963  2288 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal/instance:
02:04:30.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "57a860cab3274fad98ff833ef6c38fb5"
02:04:30.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:30 on dist-test-slave-kvfs"
02:04:30.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.162465  2288 fs_manager.cc:696] Time spent creating directory manager: real 0.027s	user 0.006s	sys 0.023s
02:04:30.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.180936  2315 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:30.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.182564  2288 fs_manager.cc:730] Time spent opening block manager: real 0.015s	user 0.006s	sys 0.009s
02:04:30.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.183017  2288 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal
02:04:30.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "57a860cab3274fad98ff833ef6c38fb5"
02:04:30.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:30 on dist-test-slave-kvfs"
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.183482  2288 fs_report.cc:389] FS layout report
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data/data
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:30.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:30.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:30.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:30.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.274788  2288 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:30.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.278369  2288 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:30.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.278954  2288 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:30.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.289340  2288 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:30.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.296645  2288 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:30.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.296981  2288 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:30.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.297293  2288 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:30.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.297492  2288 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:30.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.552367  2288 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.193:43043
02:04:30.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.552524  2499 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.193:43043 every 8 connection(s)
02:04:30.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.556202  2288 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/data/info.pb
02:04:30.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.565119  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 2288
02:04:30.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.565825  1795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-0/wal/instance
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.601713  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/logs
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data/info.pb
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:30.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:30.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:30.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.194:0
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.192.194
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.194
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:30.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:30.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.629546  2500 heartbeater.cc:344] Connected to a master server at 127.1.192.253:44361
02:04:30.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.630499  2500 heartbeater.cc:461] Registering TS with master...
02:04:30.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.632500  2500 heartbeater.cc:507] Master 127.1.192.253:44361 requested a full tablet report, sending...
02:04:30.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.637267  1981 ts_manager.cc:194] Registered new tserver with Master: 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043)
02:04:30.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.654754  2509 heartbeater.cc:344] Connected to a master server at 127.1.192.254:36703
02:04:30.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.655228  2509 heartbeater.cc:461] Registering TS with master...
02:04:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.656411  2509 heartbeater.cc:507] Master 127.1.192.254:36703 requested a full tablet report, sending...
02:04:30.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.660868  1866 ts_manager.cc:194] Registered new tserver with Master: 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043)
02:04:30.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.662424  2502 heartbeater.cc:344] Connected to a master server at 127.1.192.252:33993
02:04:30.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.663080  2502 heartbeater.cc:461] Registering TS with master...
02:04:30.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.664772  2502 heartbeater.cc:507] Master 127.1.192.252:33993 requested a full tablet report, sending...
02:04:30.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.668216  2126 ts_manager.cc:194] Registered new tserver with Master: 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043)
02:04:30.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:30.671269  2126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.192.193:47807
02:04:31.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.055842  2516 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:31.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.056475  2516 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:31.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.056911  2516 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:31.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.094314  2516 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:31.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.095283  2516 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.192.194
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:31.137480  2516 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/logs
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:31.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.194:0
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data/info.pb
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.194
02:04:31.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.192.194
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:31.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:31.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:31.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:31.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:31.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:31.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:31.140146  2516 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:31.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:31.142582  2516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:31.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.162981  2528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:31.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:31.676949  2502 heartbeater.cc:499] Master 127.1.192.252:33993 was elected leader, sending a full tablet report...
02:04:33.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:32.563102  2526 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 2516
02:04:33.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:33.357937  2526 kernel_stack_watchdog.cc:198] Thread 2516 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
02:04:33.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:33.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:33.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:33.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:33.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:33.358215  2516 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.197s	user 0.790s	sys 1.346s
02:04:33.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:33.358579  2516 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.197s	user 0.790s	sys 1.346s
02:04:33.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:31.163249  2527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:33.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:33.361749  2530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:33.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:33.365368  2529 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2200 milliseconds
02:04:33.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.365374  2516 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:33.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.367270  2516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:33.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.369738  2516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:33.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.371204  2516 hybrid_clock.cc:648] HybridClock initialized: now 1786500273371164 us; error 57 us; skew 500 ppm
02:04:33.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.372177  2516 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:33.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.379513  2516 webserver.cc:533] Webserver started at http://127.1.192.194:40451/ using document root <none> and password file <none>
02:04:33.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.380697  2516 fs_manager.cc:362] Metadata directory not provided
02:04:33.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.380936  2516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:33.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.381378  2516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:33.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.386209  2516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data/instance:
02:04:33.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86"
02:04:33.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:33 on dist-test-slave-kvfs"
02:04:33.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.387519  2516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal/instance:
02:04:33.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86"
02:04:33.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:33 on dist-test-slave-kvfs"
02:04:33.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.396579  2516 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.002s
02:04:33.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.403317  2547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:33.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.405006  2516 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.003s
02:04:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.405524  2516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal
02:04:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86"
02:04:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:33 on dist-test-slave-kvfs"
02:04:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.405968  2516 fs_report.cc:389] FS layout report
02:04:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:33.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data/data
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:33.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:33.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.475841  2516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:33.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.478189  2516 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:33.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.478816  2516 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:33.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.482729  2516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:33.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.488803  2516 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:33.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.489133  2516 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:33.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.489496  2516 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:33.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.489773  2516 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:33.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.667948  2516 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.194:41043
02:04:33.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.668215  2725 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.194:41043 every 8 connection(s)
02:04:33.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.671608  2516 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/data/info.pb
02:04:33.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.681043  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 2516
02:04:33.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.681703  1795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal/instance
02:04:33.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.702316  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/logs
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data/info.pb
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:33.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.195:0
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.192.195
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.195
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:33.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:33.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.734264  2726 heartbeater.cc:344] Connected to a master server at 127.1.192.253:44361
02:04:33.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.734922  2726 heartbeater.cc:461] Registering TS with master...
02:04:33.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.737077  2726 heartbeater.cc:507] Master 127.1.192.253:44361 requested a full tablet report, sending...
02:04:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.738708  2727 heartbeater.cc:344] Connected to a master server at 127.1.192.252:33993
02:04:33.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.739120  2727 heartbeater.cc:461] Registering TS with master...
02:04:33.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.740239  2727 heartbeater.cc:507] Master 127.1.192.252:33993 requested a full tablet report, sending...
02:04:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.740550  2729 heartbeater.cc:344] Connected to a master server at 127.1.192.254:36703
02:04:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.740864  2729 heartbeater.cc:461] Registering TS with master...
02:04:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.741762  2729 heartbeater.cc:507] Master 127.1.192.254:36703 requested a full tablet report, sending...
02:04:33.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.741807  1981 ts_manager.cc:194] Registered new tserver with Master: fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043)
02:04:33.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.744146  2126 ts_manager.cc:194] Registered new tserver with Master: fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043)
02:04:33.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.744817  1866 ts_manager.cc:194] Registered new tserver with Master: fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043)
02:04:33.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:33.746766  2126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.192.194:58135
02:04:34.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.093067  2746 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:34.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.093672  2746 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:34.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.094295  2746 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:34.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.133344  2746 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:34.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.134387  2746 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.192.195
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:34.178699  2746 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/logs
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.195:0
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data/info.pb
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.195
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.192.195
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:34.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:34.180735  2746 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:34.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:34.183022  2746 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:34.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.198971  2753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:34.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:34.751464  2727 heartbeater.cc:499] Master 127.1.192.252:33993 was elected leader, sending a full tablet report...
02:04:35.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.206364  2758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:35.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:34.198976  2754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:35.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:35.530856  2755 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:04:35.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.530989  2746 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:35.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.536782  2746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:35.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.540100  2746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:35.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.541651  2746 hybrid_clock.cc:648] HybridClock initialized: now 1786500275541575 us; error 95 us; skew 500 ppm
02:04:35.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.542771  2746 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:35.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.553822  2746 webserver.cc:533] Webserver started at http://127.1.192.195:45421/ using document root <none> and password file <none>
02:04:35.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.557022  2746 fs_manager.cc:362] Metadata directory not provided
02:04:35.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.557623  2746 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:35.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.558604  2746 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:35.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.565503  2746 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data/instance:
02:04:35.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e57bdee316ea4583896b6cbdbe43cb06"
02:04:35.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:35 on dist-test-slave-kvfs"
02:04:35.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.567212  2746 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal/instance:
02:04:35.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e57bdee316ea4583896b6cbdbe43cb06"
02:04:35.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:35 on dist-test-slave-kvfs"
02:04:35.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.579668  2746 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.010s	sys 0.000s
02:04:35.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.587121  2772 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:35.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.588721  2746 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.001s
02:04:35.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.589167  2746 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal
02:04:35.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e57bdee316ea4583896b6cbdbe43cb06"
02:04:35.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:35 on dist-test-slave-kvfs"
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.589639  2746 fs_report.cc:389] FS layout report
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data/data
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:35.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:35.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.656423  2746 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:35.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.658250  2746 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:35.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.658867  2746 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:35.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.661962  2746 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:35.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.669178  2746 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:35.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.669463  2746 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:35.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.669782  2746 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:35.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.670076  2746 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:35.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.864982  2746 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.195:33617
02:04:35.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.865686  2937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.195:33617 every 8 connection(s)
02:04:35.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.868212  2746 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/data/info.pb
02:04:35.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.875967  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 2746
02:04:35.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.876670  1795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-2/wal/instance
02:04:35.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.918220  2938 heartbeater.cc:344] Connected to a master server at 127.1.192.253:44361
02:04:35.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.918907  2938 heartbeater.cc:461] Registering TS with master...
02:04:35.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.920461  2938 heartbeater.cc:507] Master 127.1.192.253:44361 requested a full tablet report, sending...
02:04:35.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.923800  2939 heartbeater.cc:344] Connected to a master server at 127.1.192.252:33993
02:04:35.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.924226  2939 heartbeater.cc:461] Registering TS with master...
02:04:35.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.925217  2939 heartbeater.cc:507] Master 127.1.192.252:33993 requested a full tablet report, sending...
02:04:35.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.925930  1981 ts_manager.cc:194] Registered new tserver with Master: e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.928125  2941 heartbeater.cc:344] Connected to a master server at 127.1.192.254:36703
02:04:35.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.928474  2941 heartbeater.cc:461] Registering TS with master...
02:04:35.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.929412  2941 heartbeater.cc:507] Master 127.1.192.254:36703 requested a full tablet report, sending...
02:04:35.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.929816  2126 ts_manager.cc:194] Registered new tserver with Master: e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:35.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.932184  2126 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.192.195:48283
02:04:35.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.932598  1866 ts_manager.cc:194] Registered new tserver with Master: e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:35.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:35.957021  1795 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
02:04:35.970 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:35.970 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:04:35.974 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.192.254"
      port: 36703
    }
    bound_http_address {
      host: "127.1.192.254"
      port: 42071
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.192.253"
      port: 44361
    }
    bound_http_address {
      host: "127.1.192.253"
      port: 33017
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.192.252"
      port: 33993
    }
    bound_http_address {
      host: "127.1.192.252"
      port: 37577
    }
  }
}

02:04:35.974 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:04:35.977 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.192.193"
      port: 43043
    }
    bound_http_address {
      host: "127.1.192.193"
      port: 39065
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.192.194"
      port: 41043
    }
    bound_http_address {
      host: "127.1.192.194"
      port: 40451
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.192.195"
      port: 33617
    }
    bound_http_address {
      host: "127.1.192.195"
      port: 45421
    }
  }
}

02:04:35.977 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:04:35.980 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:04:35.983 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.1.192.254:36703(127.1.192.254:36703)] connecting to peer
02:04:35.985 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.1.192.253:44361(127.1.192.253:44361)] connecting to peer
02:04:35.986 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.1.192.252:33993(127.1.192.252:33993)] connecting to peer
02:04:35.986 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.192.254:36703(127.1.192.254:36703)] Successfully connected to peer
02:04:35.988 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.192.253:44361(127.1.192.253:44361)] Successfully connected to peer
02:04:35.994 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.1.192.254
02:04:35.997 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.1.192.253
02:04:36.000 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.192.252:33993(127.1.192.252:33993)] Successfully connected to peer
02:04:36.009 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.1.192.252
02:04:36.040 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xa2056069, L:/127.0.0.1:52240 - R:/127.1.192.253:44361] using SASL/PLAIN
02:04:36.043 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x03605d56, L:/127.0.0.1:40030 - R:/127.1.192.252:33993] using SASL/PLAIN
02:04:36.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:36.051 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=70), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [68ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: OK, [69ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, deferred=null) after lookup
02:04:36.055 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x50e6d0f3, L:/127.0.0.1:48456 - R:/127.1.192.254:36703] using SASL/PLAIN
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.054577  2126 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40030:
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:36.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:04:36.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:36.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:36.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:36.059060  2126 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:04:36.115 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table aa151d8c65c34859a1ed184be5dce010
02:04:36.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.175364  2392 tablet_service.cc:1511] Processing CreateTablet for tablet a6922f938f0c4e6e9510c5b7c3c922bd (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=aa151d8c65c34859a1ed184be5dce010]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:36.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.178570  2392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6922f938f0c4e6e9510c5b7c3c922bd. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:36.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.188392  2838 tablet_service.cc:1511] Processing CreateTablet for tablet a6922f938f0c4e6e9510c5b7c3c922bd (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=aa151d8c65c34859a1ed184be5dce010]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:36.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.191395  2838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6922f938f0c4e6e9510c5b7c3c922bd. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:36.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.201664  2622 tablet_service.cc:1511] Processing CreateTablet for tablet a6922f938f0c4e6e9510c5b7c3c922bd (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=aa151d8c65c34859a1ed184be5dce010]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:36.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.213160  2622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6922f938f0c4e6e9510c5b7c3c922bd. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:36.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.253479  2988 tablet_bootstrap.cc:492] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: Bootstrap starting.
02:04:36.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.257858  2990 tablet_bootstrap.cc:492] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: Bootstrap starting.
02:04:36.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.265652  2988 tablet_bootstrap.cc:654] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: Neither blocks nor log segments found. Creating new log.
02:04:36.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.268746  2988 log.cc:826] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: Log is configured to *not* fsync() on all Append() calls
02:04:36.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.270077  2990 tablet_bootstrap.cc:654] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: Neither blocks nor log segments found. Creating new log.
02:04:36.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.273451  2992 tablet_bootstrap.cc:492] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Bootstrap starting.
02:04:36.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.273624  2990 log.cc:826] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: Log is configured to *not* fsync() on all Append() calls
02:04:36.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.295619  2988 tablet_bootstrap.cc:492] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: No bootstrap required, opened a new log
02:04:36.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.296298  2988 ts_tablet_manager.cc:1403] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.012s
02:04:36.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.300304  2990 tablet_bootstrap.cc:492] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: No bootstrap required, opened a new log
02:04:36.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.301096  2990 ts_tablet_manager.cc:1403] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.010s
02:04:36.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.305691  2992 tablet_bootstrap.cc:654] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Neither blocks nor log segments found. Creating new log.
02:04:36.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.309348  2992 log.cc:826] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Log is configured to *not* fsync() on all Append() calls
02:04:36.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.334388  2988 raft_consensus.cc:359] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.335551  2988 raft_consensus.cc:385] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:36.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.335867  2988 raft_consensus.cc:740] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57a860cab3274fad98ff833ef6c38fb5, State: Initialized, Role: FOLLOWER
02:04:36.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.336990  2988 consensus_queue.cc:260] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.339425  2990 raft_consensus.cc:359] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.340538  2990 raft_consensus.cc:385] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:36.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.341777  2990 raft_consensus.cc:740] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e57bdee316ea4583896b6cbdbe43cb06, State: Initialized, Role: FOLLOWER
02:04:36.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.343410  2990 consensus_queue.cc:260] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.354185  2992 tablet_bootstrap.cc:492] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: No bootstrap required, opened a new log
02:04:36.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.354964  2992 ts_tablet_manager.cc:1403] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.008s
02:04:36.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.357120  2988 ts_tablet_manager.cc:1434] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: Time spent starting tablet: real 0.060s	user 0.033s	sys 0.013s
02:04:36.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.365875  2990 ts_tablet_manager.cc:1434] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: Time spent starting tablet: real 0.064s	user 0.045s	sys 0.013s
02:04:36.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.368912  2939 heartbeater.cc:499] Master 127.1.192.252:33993 was elected leader, sending a full tablet report...
02:04:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:36.392275  2514 tablet.cc:2406] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:36.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:36.392863  2945 tablet.cc:2406] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:36.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.397367  2992 raft_consensus.cc:359] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.398197  2992 raft_consensus.cc:385] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:36.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.398412  2992 raft_consensus.cc:740] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa427bfb4b4a4c6f91d498eb1ea5ce86, State: Initialized, Role: FOLLOWER
02:04:36.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.399290  2992 consensus_queue.cc:260] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.403398  2992 ts_tablet_manager.cc:1434] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Time spent starting tablet: real 0.048s	user 0.032s	sys 0.004s
02:04:36.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:36.459354  2734 tablet.cc:2406] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:36.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.624704  2998 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:36.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.625263  2998 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.628473  2998 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043), fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043)
02:04:36.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.642769  2424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "e57bdee316ea4583896b6cbdbe43cb06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57a860cab3274fad98ff833ef6c38fb5" is_pre_election: true
02:04:36.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.644112  2424 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e57bdee316ea4583896b6cbdbe43cb06 in term 0.
02:04:36.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.646134  2776 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5, e57bdee316ea4583896b6cbdbe43cb06; no voters: 
02:04:36.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.647854  2998 raft_consensus.cc:2804] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:36.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.647893  2652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "e57bdee316ea4583896b6cbdbe43cb06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" is_pre_election: true
02:04:36.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.648365  2998 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:36.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.648712  2998 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 0 FOLLOWER]: Advancing to term 1
02:04:36.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.648994  2652 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e57bdee316ea4583896b6cbdbe43cb06 in term 0.
02:04:36.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.655184  2998 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.657167  2998 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [CANDIDATE]: Term 1 election: Requested vote from peers 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043), fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043)
02:04:36.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.658293  2424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "e57bdee316ea4583896b6cbdbe43cb06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57a860cab3274fad98ff833ef6c38fb5"
02:04:36.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.658401  2652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "e57bdee316ea4583896b6cbdbe43cb06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86"
02:04:36.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.658876  2424 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 0 FOLLOWER]: Advancing to term 1
02:04:36.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.659024  2652 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 0 FOLLOWER]: Advancing to term 1
02:04:36.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.666059  2424 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e57bdee316ea4583896b6cbdbe43cb06 in term 1.
02:04:36.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.668056  2776 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5, e57bdee316ea4583896b6cbdbe43cb06; no voters: 
02:04:36.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.668383  2652 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e57bdee316ea4583896b6cbdbe43cb06 in term 1.
02:04:36.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.669013  2998 raft_consensus.cc:2804] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 1 FOLLOWER]: Leader election won for term 1
02:04:36.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.671908  2998 raft_consensus.cc:697] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [term 1 LEADER]: Becoming Leader. State: Replica: e57bdee316ea4583896b6cbdbe43cb06, State: Running, Role: LEADER
02:04:36.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.673260  2998 consensus_queue.cc:237] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:36.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:36.695109  2126 catalog_manager.cc:5719] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 reported cstate change: term changed from 0 to 1, leader changed from <none> to e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195). New cstate: current_term: 1 leader_uuid: "e57bdee316ea4583896b6cbdbe43cb06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } health_report { overall_health: HEALTHY } } }
02:04:37.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:37.109439  2998 consensus_queue.cc:1048] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:37.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:37.133592  3006 consensus_queue.cc:1048] T a6922f938f0c4e6e9510c5b7c3c922bd P e57bdee316ea4583896b6cbdbe43cb06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:37.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:37.327070  2031 debug-util.cc:398] Leaking SignalData structure 0x7b0800097960 after lost signal to thread 1932
02:04:37.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:37.327824  2031 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6440 after lost signal to thread 2037
02:04:37.331 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table aa151d8c65c34859a1ed184be5dce010
02:04:37.338 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:37.339 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:37.339 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=8), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [7ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: OK, deferred=null) after lookup
02:04:37.340 [DEBUG - kudu-nio-2] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:37.344 [DEBUG - kudu-nio-3] (Connection.java:757) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] Successfully connected to peer
02:04:37.380 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x8aad06c7, L:/127.0.0.1:55928 - R:/127.1.192.195:33617] using TOKEN/null
02:04:37.710 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:37.711 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.1.192.252:33993
02:04:37.712 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:04:37.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:37.712757  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 2044
02:04:37.792 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.192.252:33993(127.1.192.252:33993)] handling channelInactive
02:04:37.793 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.192.252:33993(127.1.192.252:33993)] cleaning up while in state READY due to: connection closed
02:04:37.800 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:37.801 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.1.192.252:33993
02:04:37.812 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:37.815601  1795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu
02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data
02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:37.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/logs
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/info.pb
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:37.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.252:33993
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.252
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=37577
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:37.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json with env {}
02:04:38.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.203364  2502 heartbeater.cc:646] Failed to heartbeat to 127.1.192.252:33993 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:38.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.209869  2727 heartbeater.cc:646] Failed to heartbeat to 127.1.192.252:33993 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:38.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.412281  3054 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:38.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.413101  3054 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:38.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.416319  3054 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:38.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.459306  2939 heartbeater.cc:646] Failed to heartbeat to 127.1.192.252:33993 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:38.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.522753  3054 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:38.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.523352  3054 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:38.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.524128  3054 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:38.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.524545  3054 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:38.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.524945  3054 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:38.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.525319  3054 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38015/jwks.json
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.627406  3054 master_runner.cc:387] Master server non-default flags:
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/logs
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.192.212:35627
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data
02:04:38.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.192.254:36703,127.1.192.253:44361,127.1.192.252:33993
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.192.252:33993
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38015/jwks.json
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/info.pb
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.192.252
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=37577
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:38.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 12 Aug 2026 01:45:55 UTC on e7f111948823
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13299
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:38.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.629451  3054 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:38.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.632200  3054 file_cache.cc:504] Constructed file cache file cache with capacity 419430
02:04:38.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.652587  3068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:38.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.779291  3076 raft_consensus.cc:493] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c928a15dfbbd441f8a335547334361d9)
02:04:38.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.790383  3076 raft_consensus.cc:515] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:38.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.797466  1881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e937e81691c449c88f500f3395c86870" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "3d088d790f86488f9628cb481fbe54fe" is_pre_election: true
02:04:38.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.804171  3076 leader_election.cc:290] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d088d790f86488f9628cb481fbe54fe (127.1.192.254:36703), c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993)
02:04:38.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.813294  1958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111) [suppressed 7 similar messages]
02:04:38.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.840423  1958 leader_election.cc:336] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993): Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:38.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.842830  1958 leader_election.cc:304] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e937e81691c449c88f500f3395c86870; no voters: 3d088d790f86488f9628cb481fbe54fe, c928a15dfbbd441f8a335547334361d9
02:04:38.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.844949  3076 raft_consensus.cc:2749] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:04:38.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.869169  3080 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c928a15dfbbd441f8a335547334361d9)
02:04:38.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.871726  3080 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:38.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.889674  1994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d088d790f86488f9628cb481fbe54fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e937e81691c449c88f500f3395c86870" is_pre_election: true
02:04:38.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.890594  1994 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d088d790f86488f9628cb481fbe54fe in term 1.
02:04:38.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.894311  3080 leader_election.cc:290] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e937e81691c449c88f500f3395c86870 (127.1.192.253:44361), c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993)
02:04:38.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.908221  1844 leader_election.cc:304] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d088d790f86488f9628cb481fbe54fe, e937e81691c449c88f500f3395c86870; no voters: 
02:04:38.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.909830  1844 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111) [suppressed 14 similar messages]
02:04:38.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.910616  3080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:38.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.911880  3080 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Starting leader election (detected failure of leader c928a15dfbbd441f8a335547334361d9)
02:04:38.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.912807  3080 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 1 FOLLOWER]: Advancing to term 2
02:04:38.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.932268  1844 leader_election.cc:336] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993): Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:38.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.937805  3080 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:38.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.942929  1994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d088d790f86488f9628cb481fbe54fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e937e81691c449c88f500f3395c86870"
02:04:38.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.943755  1994 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 1 FOLLOWER]: Advancing to term 2
02:04:38.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.966423  1844 leader_election.cc:336] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993): Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111)
02:04:38.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.968227  3080 leader_election.cc:290] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [CANDIDATE]: Term 2 election: Requested vote from peers e937e81691c449c88f500f3395c86870 (127.1.192.253:44361), c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993)
02:04:38.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.971793  1994 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d088d790f86488f9628cb481fbe54fe in term 2.
02:04:38.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.975427  1844 leader_election.cc:304] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d088d790f86488f9628cb481fbe54fe, e937e81691c449c88f500f3395c86870; no voters: c928a15dfbbd441f8a335547334361d9
02:04:38.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.977231  3080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 2 FOLLOWER]: Leader election won for term 2
02:04:38.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.985556  3080 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [term 2 LEADER]: Becoming Leader. State: Replica: 3d088d790f86488f9628cb481fbe54fe, State: Running, Role: LEADER
02:04:38.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.988093  3080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:39.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.002151  3084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d088d790f86488f9628cb481fbe54fe. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:39.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.012270  3084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: This master's current role is: LEADER
02:04:39.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.032621  3086 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
02:04:39.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.056828  3086 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=aa151d8c65c34859a1ed184be5dce010]
02:04:39.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.080083  3086 tablet_loader.cc:96] loaded metadata for tablet a6922f938f0c4e6e9510c5b7c3c922bd (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=aa151d8c65c34859a1ed184be5dce010])
02:04:39.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.082609  3086 catalog_manager.cc:1520] Initializing Kudu cluster ID...
02:04:39.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.106554  3086 catalog_manager.cc:1295] Loaded cluster ID: 6ce2fa453b274f21906ca6bc76abeacd
02:04:39.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.107345  3086 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
02:04:39.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.118645  3086 catalog_manager.cc:1540] Loading token signing keys...
02:04:39.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.131943  3086 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: Loaded TSK: 0
02:04:39.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.133978  3086 catalog_manager.cc:1550] Initializing in-progress tserver states...
02:04:39.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.407011  1994 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [term 2 FOLLOWER]: Refusing update from remote peer 3d088d790f86488f9628cb481fbe54fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:04:39.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.409652  3084 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
02:04:39.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.445814  3089 sys_catalog.cc:455] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d088d790f86488f9628cb481fbe54fe. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:39.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.447620  3089 sys_catalog.cc:458] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: This master's current role is: FOLLOWER
02:04:39.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.482615  3080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:39.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.483464  3080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: This master's current role is: LEADER
02:04:39.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.493249  3089 sys_catalog.cc:455] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:39.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:39.494855  3089 sys_catalog.cc:458] T 00000000000000000000000000000000 P e937e81691c449c88f500f3395c86870 [sys.catalog]: This master's current role is: FOLLOWER
02:04:39.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:39.509784  1844 consensus_peers.cc:597] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe -> Peer c928a15dfbbd441f8a335547334361d9 (127.1.192.252:33993): Couldn't send request to peer c928a15dfbbd441f8a335547334361d9. Status: Network error: Client connection negotiation failed: client connection to 127.1.192.252:33993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:40.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.222615  2509 heartbeater.cc:499] Master 127.1.192.254:36703 was elected leader, sending a full tablet report...
02:04:40.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.243883  2729 heartbeater.cc:499] Master 127.1.192.254:36703 was elected leader, sending a full tablet report...
02:04:40.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.676800  3069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:40.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:38.681403  3054 server_base.cc:1061] running on GCE node
02:04:40.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:38.674703  3073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:40.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.492900  2941 heartbeater.cc:499] Master 127.1.192.254:36703 was elected leader, sending a full tablet report...
02:04:40.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.496310  3054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:40.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.501201  3054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:40.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.502807  3054 hybrid_clock.cc:648] HybridClock initialized: now 1786500280502764 us; error 39 us; skew 500 ppm
02:04:40.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.503965  3054 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:40.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.512873  3054 webserver.cc:533] Webserver started at http://127.1.192.252:37577/ using document root <none> and password file <none>
02:04:40.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.514336  3054 fs_manager.cc:362] Metadata directory not provided
02:04:40.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.514671  3054 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:40.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.527734  3054 fs_manager.cc:714] Time spent opening directory manager: real 0.008s	user 0.010s	sys 0.001s
02:04:40.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.535310  3122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:40.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.536800  3054 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
02:04:40.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.537129  3054 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data,/tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:40.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c928a15dfbbd441f8a335547334361d9"
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 02:04:24 on dist-test-slave-kvfs"
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.539487  3054 fs_report.cc:389] FS layout report
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/wal
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/data
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:40.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:40.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.612257  3054 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:40.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.614405  3054 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:40.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.614923  3054 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:40.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.760296  3218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.192.252:33993 every 8 connection(s)
02:04:40.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.760309  3054 rpc_server.cc:307] RPC server started. Bound to: 127.1.192.252:33993
02:04:40.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.766008  3054 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/master-2/data/info.pb
02:04:40.770 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:40.771 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.1.192.195:33617
02:04:40.771 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

02:04:40.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.769083  1795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu as pid 3054
02:04:40.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.772586  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 2746
02:04:40.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.794996  3219 sys_catalog.cc:263] Verifying existing consensus state
02:04:40.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.800885  3219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Bootstrap starting.
02:04:40.825 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:40.825 [DEBUG - kudu-nio-3] (Connection.java:239) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] handling channelInactive
02:04:40.825 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state READY due to: connection closed
02:04:40.828 [DEBUG - Time-limited test] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:40.830 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.831 [DEBUG - kudu-nio-4] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.831 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.844 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.1.192.252:33993(127.1.192.252:33993)] connecting to peer
02:04:40.848 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.1.192.252:33993(127.1.192.252:33993)] Successfully connected to peer
02:04:40.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.853880  3219 log.cc:826] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Log is configured to *not* fsync() on all Append() calls
02:04:40.860 [DEBUG - kudu-nio-5] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.1.192.252
02:04:40.884 [DEBUG - kudu-nio-5] (Negotiator.java:918) Authenticated connection [id: 0xf0373d45, L:/127.0.0.1:40146 - R:/127.1.192.252:33993] using SASL/PLAIN
02:04:40.894 [DEBUG - kudu-nio-5] (RemoteTablet.java:167) master-127.1.192.252:33993 was demoted as the leader for Kudu Master
02:04:40.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.896816  3219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
02:04:40.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.897826  3219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: Bootstrap complete.
02:04:40.910 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:40.910 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29983, elapsed=67), Traces: [0ms] sending RPC to server master-127.1.192.252:33993, [51ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [51ms] received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [64ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1064668604(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
02:04:40.910 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.1.192.252:33993: Catalog manager is not initialized. State: Starting
02:04:40.917 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:40.917 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:40.918 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=92), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test)) after lookup
02:04:40.919 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:40.921 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.922 [DEBUG - kudu-nio-6] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.922 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.926908  3219 raft_consensus.cc:359] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:40.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.929607  3219 raft_consensus.cc:740] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c928a15dfbbd441f8a335547334361d9, State: Initialized, Role: FOLLOWER
02:04:40.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.930737  3219 consensus_queue.cc:260] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } }
02:04:40.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.934006  3231 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:40.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.934629  3231 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: FOLLOWER
02:04:40.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.935467  3219 sys_catalog.cc:565] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: configured and running, proceeding with master startup.
02:04:40.950 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:40.951 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:40.952 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=126), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478))) after lookup
02:04:40.953 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:40.956 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.957 [DEBUG - kudu-nio-7] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.957 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.973351  3246 catalog_manager.cc:1295] Loaded cluster ID: 6ce2fa453b274f21906ca6bc76abeacd
02:04:40.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.973706  3246 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: loading cluster ID for follower catalog manager: success
02:04:40.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.981249  3246 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: acquiring CA information for follower catalog manager: success
02:04:40.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:40.987887  3246 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:40.988 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:40.989 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:40.990 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=163), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [126ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [130ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [130ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [155ms] refreshing cache from master, [155ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [161ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075))) after lookup
02:04:40.993 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:40.994 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.996 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:40.997 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.067 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:41.068 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:41.068 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=243), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [126ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [130ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [130ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [155ms] refreshing cache from master, [155ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [161ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [165ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [170ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [170ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [235ms] refreshing cache from master, [236ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [240ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394))) after lookup
02:04:41.069 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:41.071 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.071 [DEBUG - kudu-nio-1] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.071 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.178191  3175 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [term 1 FOLLOWER]: Advancing to term 2
02:04:41.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.197430  3263 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:41.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.199524  3263 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: FOLLOWER
02:04:41.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.203986  3231 sys_catalog.cc:455] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d088d790f86488f9628cb481fbe54fe. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:41.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.204618  3231 sys_catalog.cc:458] T 00000000000000000000000000000000 P c928a15dfbbd441f8a335547334361d9 [sys.catalog]: This master's current role is: FOLLOWER
02:04:41.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.262329  2502 heartbeater.cc:344] Connected to a master server at 127.1.192.252:33993
02:04:41.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.272464  3157 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" instance_seqno: 1786500270493459) as {username='slave'} at 127.1.192.193:59413; Asking this server to re-register.
02:04:41.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.276265  2502 heartbeater.cc:461] Registering TS with master...
02:04:41.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.280265  3157 ts_manager.cc:194] Registered new tserver with Master: 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043)
02:04:41.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.283951  2727 heartbeater.cc:344] Connected to a master server at 127.1.192.252:33993
02:04:41.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.287218  3157 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" instance_seqno: 1786500273621911) as {username='slave'} at 127.1.192.194:39865; Asking this server to re-register.
02:04:41.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.288772  2727 heartbeater.cc:461] Registering TS with master...
02:04:41.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.292100  3157 ts_manager.cc:194] Registered new tserver with Master: fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043)
02:04:41.369 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:41.369 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:41.370 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=544), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [126ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [130ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [130ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [155ms] refreshing cache from master, [155ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [161ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [165ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [170ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [170ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [235ms] refreshing cache from master, [236ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [240ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [242ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [244ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [244ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [535ms] refreshing cache from master, [535ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [541ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188))) after lookup
02:04:41.374 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:41.376 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.376 [DEBUG - kudu-nio-2] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.376 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.607332  3084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3d088d790f86488f9628cb481fbe54fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d088d790f86488f9628cb481fbe54fe" member_type: VOTER last_known_addr { host: "127.1.192.254" port: 36703 } } peers { permanent_uuid: "e937e81691c449c88f500f3395c86870" member_type: VOTER last_known_addr { host: "127.1.192.253" port: 44361 } } peers { permanent_uuid: "c928a15dfbbd441f8a335547334361d9" member_type: VOTER last_known_addr { host: "127.1.192.252" port: 33993 } } }
02:04:41.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:41.608199  3084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe [sys.catalog]: This master's current role is: LEADER
02:04:41.868 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:41.868 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:41.869 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1043), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [126ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [130ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [130ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [155ms] refreshing cache from master, [155ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [161ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [165ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [170ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [170ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [235ms] refreshing cache from master, [236ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [240ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [242ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [244ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [244ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [535ms] refreshing cache from master, [535ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [541ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [543ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [549ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [549ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [1035ms] refreshing cache from master, [1036ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [1041ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188) -> (continuation of Deferred@1815399863 after retry RPC@1146170460), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188) -> (continuation of Deferred@1815399863 after retry RPC@1146170460))) after lookup
02:04:41.870 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:41.871 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.871 [DEBUG - kudu-nio-3] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:41.872 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:42.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.228449  3272 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e57bdee316ea4583896b6cbdbe43cb06)
02:04:42.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.229260  3272 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:42.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.230476  3273 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e57bdee316ea4583896b6cbdbe43cb06)
02:04:42.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.231222  3273 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:42.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.232889  3272 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043), e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:42.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.248370  3273 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043), e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:42.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:42.254583  2318 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:42.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.266633  2651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "57a860cab3274fad98ff833ef6c38fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" is_pre_election: true
02:04:42.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.267845  2651 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57a860cab3274fad98ff833ef6c38fb5 in term 1.
02:04:42.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:42.270191  2552 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:42.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:42.285056  2552 leader_election.cc:336] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:42.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.287477  2424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "57a860cab3274fad98ff833ef6c38fb5" is_pre_election: true
02:04:42.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.288338  2424 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa427bfb4b4a4c6f91d498eb1ea5ce86 in term 1.
02:04:42.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.280634  2320 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5, fa427bfb4b4a4c6f91d498eb1ea5ce86; no voters: 
02:04:42.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.291020  3272 raft_consensus.cc:2804] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:42.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.291450  3272 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e57bdee316ea4583896b6cbdbe43cb06)
02:04:42.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.291869  3272 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 1 FOLLOWER]: Advancing to term 2
02:04:42.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.292706  2552 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5, fa427bfb4b4a4c6f91d498eb1ea5ce86; no voters: e57bdee316ea4583896b6cbdbe43cb06
02:04:42.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.295117  3273 raft_consensus.cc:2804] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:42.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.295578  3273 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e57bdee316ea4583896b6cbdbe43cb06)
02:04:42.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.295930  3273 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 1 FOLLOWER]: Advancing to term 2
02:04:42.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:42.302249  2318 leader_election.cc:336] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:42.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.304273  3272 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:42.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.307816  3272 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [CANDIDATE]: Term 2 election: Requested vote from peers fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043), e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:42.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.308943  3273 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:42.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.312953  2651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "57a860cab3274fad98ff833ef6c38fb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86"
02:04:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.313854  2651 raft_consensus.cc:2393] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 57a860cab3274fad98ff833ef6c38fb5 in current term 2: Already voted for candidate fa427bfb4b4a4c6f91d498eb1ea5ce86 in this term.
02:04:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.315044  2424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "57a860cab3274fad98ff833ef6c38fb5"
02:04:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.315882  2424 raft_consensus.cc:2393] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fa427bfb4b4a4c6f91d498eb1ea5ce86 in current term 2: Already voted for candidate 57a860cab3274fad98ff833ef6c38fb5 in this term.
02:04:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:42.316576  2318 leader_election.cc:336] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:42.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.317049  2318 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5; no voters: e57bdee316ea4583896b6cbdbe43cb06, fa427bfb4b4a4c6f91d498eb1ea5ce86
02:04:42.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.318518  3272 raft_consensus.cc:2749] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
02:04:42.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.312429  3273 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 2 election: Requested vote from peers 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043), e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:42.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:42.321321  2552 leader_election.cc:336] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:42.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.321820  2552 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa427bfb4b4a4c6f91d498eb1ea5ce86; no voters: 57a860cab3274fad98ff833ef6c38fb5, e57bdee316ea4583896b6cbdbe43cb06
02:04:42.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:42.322659  3273 raft_consensus.cc:2749] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
02:04:43.409 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:43.409 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)[L],fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)]}]
02:04:43.410 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=14, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2584), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [126ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [130ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [130ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [155ms] refreshing cache from master, [155ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [161ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [165ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [170ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [170ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [235ms] refreshing cache from master, [236ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [240ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [242ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [244ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [244ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [535ms] refreshing cache from master, [535ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [541ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [543ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [549ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [549ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [1035ms] refreshing cache from master, [1036ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [1041ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [1043ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [1045ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [1045ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [2576ms] refreshing cache from master, [2576ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [2581ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188) -> (continuation of Deferred@1815399863 after retry RPC@1146170460) -> (continuation of Deferred@709924331 after retry RPC@1739489073), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188) -> (continuation of Deferred@1815399863 after retry RPC@1146170460) -> (continuation of Deferred@709924331 after retry RPC@1739489073))) after lookup
02:04:43.411 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] connecting to peer
02:04:43.412 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:43.412 [DEBUG - kudu-nio-4] (Connection.java:709) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] cleaning up while in state CONNECTING due to: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:43.413 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617) for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617
02:04:44.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.002765  3290 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:44.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.003185  3290 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:44.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.004819  3290 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043), e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:44.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.006129  2424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "57a860cab3274fad98ff833ef6c38fb5" is_pre_election: true
02:04:44.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.006839  2424 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa427bfb4b4a4c6f91d498eb1ea5ce86 in term 2.
02:04:44.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.009536  2552 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5, fa427bfb4b4a4c6f91d498eb1ea5ce86; no voters: 
02:04:44.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.010505  3290 raft_consensus.cc:2804] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Leader pre-election won for term 3
02:04:44.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.010830  3290 raft_consensus.cc:493] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:44.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.011029  3290 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 2 FOLLOWER]: Advancing to term 3
02:04:44.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:44.012755  2552 leader_election.cc:336] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:44.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.016410  3290 raft_consensus.cc:515] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:44.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.018052  3290 leader_election.cc:290] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 3 election: Requested vote from peers 57a860cab3274fad98ff833ef6c38fb5 (127.1.192.193:43043), e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617)
02:04:44.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.019577  2424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6922f938f0c4e6e9510c5b7c3c922bd" candidate_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "57a860cab3274fad98ff833ef6c38fb5"
02:04:44.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.020382  2424 raft_consensus.cc:3060] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 2 FOLLOWER]: Advancing to term 3
02:04:44.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:44.023672  2552 leader_election.cc:336] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:44.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.027166  2424 raft_consensus.cc:2468] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa427bfb4b4a4c6f91d498eb1ea5ce86 in term 3.
02:04:44.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.028700  2552 leader_election.cc:304] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57a860cab3274fad98ff833ef6c38fb5, fa427bfb4b4a4c6f91d498eb1ea5ce86; no voters: e57bdee316ea4583896b6cbdbe43cb06
02:04:44.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.029681  3290 raft_consensus.cc:2804] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 3 FOLLOWER]: Leader election won for term 3
02:04:44.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.031365  3290 raft_consensus.cc:697] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 3 LEADER]: Becoming Leader. State: Replica: fa427bfb4b4a4c6f91d498eb1ea5ce86, State: Running, Role: LEADER
02:04:44.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.033712  3290 consensus_queue.cc:237] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } }
02:04:44.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.044859  1866 catalog_manager.cc:5719] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 reported cstate change: term changed from 1 to 3, leader changed from e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195) to fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194). New cstate: current_term: 3 leader_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa427bfb4b4a4c6f91d498eb1ea5ce86" member_type: VOTER last_known_addr { host: "127.1.192.194" port: 41043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e57bdee316ea4583896b6cbdbe43cb06" member_type: VOTER last_known_addr { host: "127.1.192.195" port: 33617 } health_report { overall_health: UNKNOWN } } }
02:04:44.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:44.573235  2552 consensus_peers.cc:597] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 -> Peer e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): Couldn't send request to peer e57bdee316ea4583896b6cbdbe43cb06. Status: Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:44.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.588574  2424 raft_consensus.cc:1275] T a6922f938f0c4e6e9510c5b7c3c922bd P 57a860cab3274fad98ff833ef6c38fb5 [term 3 FOLLOWER]: Refusing update from remote peer fa427bfb4b4a4c6f91d498eb1ea5ce86: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
02:04:44.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:44.590160  3312 consensus_queue.cc:1048] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57a860cab3274fad98ff833ef6c38fb5" member_type: VOTER last_known_addr { host: "127.1.192.193" port: 43043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
02:04:46.548 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a6922f938f0c4e6e9510c5b7c3c922bd for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:46.548 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a6922f938f0c4e6e9510c5b7c3c922bd@[57a860cab3274fad98ff833ef6c38fb5(127.1.192.193:43043),e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617),fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)[L]]}]
02:04:46.549 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, attempt=16, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=5723), Traces: [0ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [4ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [4ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [16ms] refreshing cache from master, [16ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.252:33993, [67ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [67ms] Sub RPC GetTableLocations: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.254:36703, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.253:44361, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.192.252:33993, [80ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.253:44361: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.254:36703: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.1.192.252:33993: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [89ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [91ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [95ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [95ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [116ms] refreshing cache from master, [116ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [123ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [126ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [130ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [130ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [155ms] refreshing cache from master, [155ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [161ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [165ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [170ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [170ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [235ms] refreshing cache from master, [236ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [240ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [242ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [244ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [244ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [535ms] refreshing cache from master, [535ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [541ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [543ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [549ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [549ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [1035ms] refreshing cache from master, [1036ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [1041ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [1043ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [1045ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [1045ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [2576ms] refreshing cache from master, [2576ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [2581ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, [2584ms] sending RPC to server e57bdee316ea4583896b6cbdbe43cb06, [2586ms] received response from server e57bdee316ea4583896b6cbdbe43cb06: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [2586ms] delaying RPC due to: Network error: Failed to connect to peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617): Connection refused: /127.1.192.195:33617, [5715ms] refreshing cache from master, [5715ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.192.254:36703, [5721ms] Sub RPC GetTableLocations: received response from server master-127.1.192.254:36703: OK, deferred=Deferred@1056200606(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$239/0x00007f19543375d8@28b0a6a7 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188) -> (continuation of Deferred@1815399863 after retry RPC@1146170460) -> (continuation of Deferred@709924331 after retry RPC@1739489073) -> (continuation of Deferred@1413543165 after retry RPC@1073958579), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3b3bd660 -> wakeup thread Time-limited test -> (continuation of Deferred@1064668604 after retry RPC@1061788478) -> (continuation of Deferred@192525035 after retry RPC@313114075) -> (continuation of Deferred@1183716872 after retry RPC@107201394) -> (continuation of Deferred@774106921 after retry RPC@910410188) -> (continuation of Deferred@1815399863 after retry RPC@1146170460) -> (continuation of Deferred@709924331 after retry RPC@1739489073) -> (continuation of Deferred@1413543165 after retry RPC@1073958579))) after lookup
02:04:46.551 [DEBUG - kudu-nio-0] (Connection.java:748) [peer fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)] connecting to peer
02:04:46.552 [DEBUG - kudu-nio-5] (Connection.java:757) [peer fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)] Successfully connected to peer
02:04:46.578 [DEBUG - kudu-nio-5] (Negotiator.java:918) Authenticated connection [id: 0x295845b4, L:/127.0.0.1:45472 - R:/127.1.192.194:41043] using TOKEN/null
02:04:46.790 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a6922f938f0c4e6e9510c5b7c3c922bd, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:46.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.793772  1866 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48456:
02:04:46.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
02:04:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.794735  1866 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48456:
02:04:46.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
02:04:46.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.844363  1866 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 3d088d790f86488f9628cb481fbe54fe: Sending DeleteTablet for 3 replicas of tablet a6922f938f0c4e6e9510c5b7c3c922bd
02:04:46.860 [DEBUG - main] (Connection.java:575) [peer master-127.1.192.253:44361(127.1.192.253:44361)] disconnecting while in state READY
02:04:46.861 [DEBUG - main] (Connection.java:575) [peer e57bdee316ea4583896b6cbdbe43cb06(127.1.192.195:33617)] disconnecting while in state TERMINATED
02:04:46.861 [DEBUG - main] (Connection.java:575) [peer master-127.1.192.252:33993(127.1.192.252:33993)] disconnecting while in state READY
02:04:46.861 [DEBUG - main] (Connection.java:575) [peer fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)] disconnecting while in state READY
02:04:46.861 [DEBUG - main] (Connection.java:575) [peer master-127.1.192.254:36703(127.1.192.254:36703)] disconnecting while in state READY
02:04:46.862 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.192.253:44361(127.1.192.253:44361)] handling channelInactive
02:04:46.862 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.192.253:44361(127.1.192.253:44361)] cleaning up while in state READY due to: connection closed
02:04:46.864 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.1.192.252:33993(127.1.192.252:33993)] handling channelInactive
02:04:46.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.1.192.252:33993(127.1.192.252:33993)] cleaning up while in state READY due to: connection closed
02:04:46.864 [DEBUG - kudu-nio-5] (Connection.java:239) [peer fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)] handling channelInactive
02:04:46.864 [DEBUG - kudu-nio-5] (Connection.java:709) [peer fa427bfb4b4a4c6f91d498eb1ea5ce86(127.1.192.194:41043)] cleaning up while in state READY due to: connection closed
02:04:46.867 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:04:46.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:46.872932  1844 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111) [suppressed 4 similar messages]
02:04:46.877 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.192.254:36703(127.1.192.254:36703)] handling channelInactive
02:04:46.877 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.192.254:36703(127.1.192.254:36703)] cleaning up while in state READY due to: connection closed
02:04:46.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.878456  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 2288
02:04:46.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.879846  2622 tablet_service.cc:1558] Processing DeleteTablet for tablet a6922f938f0c4e6e9510c5b7c3c922bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 02:04:46 UTC) from {username='slave'} at 127.0.0.1:45488
02:04:46.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:46.891947  1844 catalog_manager.cc:4777] TS e57bdee316ea4583896b6cbdbe43cb06 (127.1.192.195:33617): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6922f938f0c4e6e9510c5b7c3c922bd: Network error: Client connection negotiation failed: client connection to 127.1.192.195:33617: connect: Connection refused (error 111)
02:04:46.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.915406  3377 tablet_replica.cc:333] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: stopping tablet replica
02:04:46.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.916859  3377 raft_consensus.cc:2243] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 3 LEADER]: Raft consensus shutting down.
02:04:46.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.921592  3377 raft_consensus.cc:2272] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86 [term 3 FOLLOWER]: Raft consensus is shut down!
02:04:46.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.925678  3377 ts_tablet_manager.cc:1916] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Deleting tablet data with delete state TABLET_DATA_DELETED
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.953572  3377 ts_tablet_manager.cc:1929] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.22
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:46.953716  3366 negotiation.cc:336] Failed RPC negotiation. Trace:
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.846446 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.1.192.193:43043 (local address 127.0.0.1:36446)
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.857629 (+ 11183us) negotiation.cc:107] Waiting for socket to connect
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.857692 (+    63us) client_negotiation.cc:175] Beginning negotiation
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.858015 (+   323us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.952146 (+ 94131us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.192.193:43043: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
02:04:46.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":10447,"thread_start_us":10131,"threads_started":1}
02:04:46.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.954856  3377 log.cc:1199] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Deleting WAL directory at /tmp/dist-test-taskyzaRjo/test-tmp/mini-kudu-cluster8258481590351484103/ts-1/wal/wals/a6922f938f0c4e6e9510c5b7c3c922bd
02:04:46.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.957327  3377 ts_tablet_manager.cc:1950] T a6922f938f0c4e6e9510c5b7c3c922bd P fa427bfb4b4a4c6f91d498eb1ea5ce86: Deleting consensus metadata
02:04:46.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 02:04:46.959546  3366 negotiation.cc:336] Failed RPC negotiation. Trace:
02:04:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.956366 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.1.192.193:43043 (local address 127.0.0.1:36448)
02:04:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.957434 (+  1068us) negotiation.cc:107] Waiting for socket to connect
02:04:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.957497 (+    63us) client_negotiation.cc:175] Beginning negotiation
02:04:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.957775 (+   278us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
02:04:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 02:04:46.958747 (+   972us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.192.193:43043: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
02:04:46.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":393}
02:04:46.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.962746  1845 catalog_manager.cc:5050] TS fa427bfb4b4a4c6f91d498eb1ea5ce86 (127.1.192.194:41043): tablet a6922f938f0c4e6e9510c5b7c3c922bd (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=aa151d8c65c34859a1ed184be5dce010]) successfully deleted
02:04:46.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:46.963672  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 2516
02:04:47.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:47.004402  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 1813
02:04:47.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:47.050767  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 1927
02:04:47.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 02:04:47.104822  1795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskyzaRjo/build/tsan/bin/kudu with pid 3054
02:04:48.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T02:04:48Z chronyd exiting

Time: 59.769

OK (2 tests)

