JUnit version 4.13.2
.14:00:05.540 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779112805530
14:00:05.592 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:00:05.649 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:00:05.658 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task78Poou/test-tmp
14:00:05.666 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
14:00:05.670 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task78Poou/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
14:00:05.911 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:00:06.087 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:00:06.088 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:00:06.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.091071 10898 mini_oidc.cc:150] Starting JWKS server
14:00:06.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.094120 10898 webserver.cc:533] Webserver started at http://127.0.0.1:38895/ using document root <none> and password file <none>
14:00:06.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.094434 10898 mini_oidc.cc:186] Starting OIDC Discovery server
14:00:06.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.095130 10898 webserver.cc:533] Webserver started at http://127.0.0.1:36915/ using document root <none> and password file <none>
14:00:06.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:00:06Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:00:06.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:00:06Z Disabled control of system clock
14:00:06.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.124293 10898 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:06.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:06.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal
14:00:06.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data
14:00:06.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:06.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:06.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:06.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:06.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:06.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:06.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/logs
14:00:06.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data/info.pb
14:00:06.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:06.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:06.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:06.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:06.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:06.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:06.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:06.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:06.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:06.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:06.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:06.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:06.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.190:33575
14:00:06.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.190
14:00:06.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:06.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:06.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:06.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:06.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:06.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:06.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:06.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:06.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38895/jwks.json with env {}
14:00:06.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.458693 10909 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:06.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.459107 10909 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:06.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.459211 10909 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:06.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.468793 10909 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:06.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.468904 10909 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:06.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.468956 10909 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:06.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.468997 10909 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:06.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.469048 10909 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:06.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.469081 10909 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38895/jwks.json
14:00:06.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.480201 10909 master_runner.cc:387] Master server non-default flags:
14:00:06.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:06.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:06.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:06.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:06.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:06.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.190:33575
14:00:06.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:06.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:06.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:06.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38895/jwks.json
14:00:06.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:06.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data/info.pb
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.190
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:06.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/logs
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:06.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:06.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:06.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:06.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.482149 10909 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:06.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.484529 10909 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:06.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.494824 10914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:06.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.495344 10915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:06.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.497098 10917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:06.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.498044 10909 server_base.cc:1061] running on GCE node
14:00:06.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.499135 10909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:06.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.500828 10909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.502097 10909 hybrid_clock.cc:648] HybridClock initialized: now 1779112806502032 us; error 57 us; skew 500 ppm
14:00:06.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.502657 10909 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:06.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.505280 10909 webserver.cc:533] Webserver started at http://127.10.164.190:37685/ using document root <none> and password file <none>
14:00:06.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.506209 10909 fs_manager.cc:362] Metadata directory not provided
14:00:06.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.506362 10909 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:06.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.506821 10909 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:06.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.509799 10909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data/instance:
14:00:06.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c9036c34c96c4d5aaf4e511ea10c160e"
14:00:06.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:06 on dist-test-slave-c15h"
14:00:06.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.510897 10909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal/instance:
14:00:06.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c9036c34c96c4d5aaf4e511ea10c160e"
14:00:06.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:06 on dist-test-slave-c15h"
14:00:06.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.517553 10909 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
14:00:06.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.521731 10923 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:06.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.523404 10909 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
14:00:06.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.523634 10909 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal
14:00:06.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c9036c34c96c4d5aaf4e511ea10c160e"
14:00:06.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:06 on dist-test-slave-c15h"
14:00:06.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.523895 10909 fs_report.cc:389] FS layout report
14:00:06.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:06.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal
14:00:06.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal
14:00:06.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data/data
14:00:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:06.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:06.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:06.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:06.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:06.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:06.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:06.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:06.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:06.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.544747 10909 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:06.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.545907 10909 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:06.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.546271 10909 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.568176 10909 rpc_server.cc:307] RPC server started. Bound to: 127.10.164.190:33575
14:00:06.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.568212 10974 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.164.190:33575 every 8 connection(s)
14:00:06.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.570096 10909 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/data/info.pb
14:00:06.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.573999 10898 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 10909
14:00:06.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.574324 10898 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-0/wal/instance
14:00:06.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.575343 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:06.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.577337 10898 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:06.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:06.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal
14:00:06.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data
14:00:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:06.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/logs
14:00:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data/info.pb
14:00:06.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:06.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:06.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.189:42291
14:00:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.189
14:00:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:06.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:06.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:06.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:06.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:06.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:06.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:06.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38895/jwks.json with env {}
14:00:06.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.584168 10975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } has no permanent_uuid. Determining permanent_uuid...
14:00:06.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.607677 10975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } has no permanent_uuid. Determining permanent_uuid...
14:00:06.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.608742 10924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.164.189:42291: connect: Connection refused (error 111)
14:00:06.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.610316 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.189:42291: Network error: Client connection negotiation failed: client connection to 127.10.164.189:42291: connect: Connection refused (error 111)
14:00:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.659679 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } attempt: 1
14:00:06.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.661839 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.189:42291: Network error: Client connection negotiation failed: client connection to 127.10.164.189:42291: connect: Connection refused (error 111)
14:00:06.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.730166 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } attempt: 2
14:00:06.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.732575 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.189:42291: Network error: Client connection negotiation failed: client connection to 127.10.164.189:42291: connect: Connection refused (error 111)
14:00:06.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.823889 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } attempt: 3
14:00:06.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.826175 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.189:42291: Network error: Client connection negotiation failed: client connection to 127.10.164.189:42291: connect: Connection refused (error 111)
14:00:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.925731 10977 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:06.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.926134 10977 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:06.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.926246 10977 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:06.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.935381 10977 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.935536 10977 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.935621 10977 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.935678 10977 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.935752 10977 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:06.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.935798 10977 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38895/jwks.json
14:00:06.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.947065 10977 master_runner.cc:387] Master server non-default flags:
14:00:06.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:06.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:06.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:06.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:06.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:06.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.189:42291
14:00:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38895/jwks.json
14:00:06.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data/info.pb
14:00:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.189
14:00:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:06.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:06.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:06.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:06.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:06.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/logs
14:00:06.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:06.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:06.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:06.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:06.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:06.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:06.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.949453 10977 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:06.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.952207 10977 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:06.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.964184 10985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:06.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.964920 10986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:06.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.965845 10988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:06.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.966742 10977 server_base.cc:1061] running on GCE node
14:00:06.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.967888 10977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:06.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.969453 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } attempt: 4
14:00:06.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.970695 10977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:06.971448 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.189:42291: Network error: Client connection negotiation failed: client connection to 127.10.164.189:42291: connect: Connection refused (error 111)
14:00:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.971938 10977 hybrid_clock.cc:648] HybridClock initialized: now 1779112806971850 us; error 70 us; skew 500 ppm
14:00:06.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.972378 10977 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:06.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.975425 10977 webserver.cc:533] Webserver started at http://127.10.164.189:46849/ using document root <none> and password file <none>
14:00:06.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.976434 10977 fs_manager.cc:362] Metadata directory not provided
14:00:06.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.976584 10977 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:06.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.977105 10977 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.980523 10977 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data/instance:
14:00:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d85af2832f0046ccb37462d810c6ff96"
14:00:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:06 on dist-test-slave-c15h"
14:00:06.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.981673 10977 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal/instance:
14:00:06.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d85af2832f0046ccb37462d810c6ff96"
14:00:06.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:06 on dist-test-slave-c15h"
14:00:06.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.988734 10977 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
14:00:06.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.992879 10994 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:06.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.994644 10977 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
14:00:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.994817 10977 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal
14:00:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d85af2832f0046ccb37462d810c6ff96"
14:00:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:06 on dist-test-slave-c15h"
14:00:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:06.995098 10977 fs_report.cc:389] FS layout report
14:00:06.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data/data
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:06.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:06.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.011451 10977 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:07.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.012382 10977 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:07.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.012632 10977 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:07.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.034700 10977 rpc_server.cc:307] RPC server started. Bound to: 127.10.164.189:42291
14:00:07.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.034801 11045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.164.189:42291 every 8 connection(s)
14:00:07.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.036650 10977 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/data/info.pb
14:00:07.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.040388 10898 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 10977
14:00:07.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.040562 10898 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-1/wal/instance
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.041818 10898 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:07.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/logs
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data/info.pb
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:07.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:07.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.188:40835
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.188
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:07.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:07.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:07.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:07.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38895/jwks.json with env {}
14:00:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.042048 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.051777 11046 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.069260 11046 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.080209 11046 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.081756 10995 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.084128 11046 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.133515 11046 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 1
14:00:07.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.135948 11046 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.204208 11046 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 2
14:00:07.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.206377 11046 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.270750 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } attempt: 5
14:00:07.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.278517 10975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.280527 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.297740 11046 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 3
14:00:07.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.299932 11046 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.331777 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 1
14:00:07.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.333985 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.402366 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 2
14:00:07.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.404418 10975 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.408241 11048 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:07.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.408577 11048 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:07.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.408659 11048 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:07.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.417451 11048 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:07.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.417562 11048 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:07.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.417616 11048 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:07.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.417656 11048 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:07.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.417708 11048 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:07.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.417742 11048 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38895/jwks.json
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.428566 11048 master_runner.cc:387] Master server non-default flags:
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data
14:00:07.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.188:40835
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38895/jwks.json
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data/info.pb
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.188
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:07.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/logs
14:00:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:07.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.430781 11048 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.433260 11048 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:07.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.443183 11046 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 4
14:00:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.443050 11057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.443552 11056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:07.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.443163 11059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.444886 11048 server_base.cc:1061] running on GCE node
14:00:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.445463 11046 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.164.188:40835: Network error: Client connection negotiation failed: client connection to 127.10.164.188:40835: connect: Connection refused (error 111)
14:00:07.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.445806 11048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:07.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.447290 11048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:07.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.448525 11048 hybrid_clock.cc:648] HybridClock initialized: now 1779112807448450 us; error 64 us; skew 500 ppm
14:00:07.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.448926 11048 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:07.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.451289 11048 webserver.cc:533] Webserver started at http://127.10.164.188:43241/ using document root <none> and password file <none>
14:00:07.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.452116 11048 fs_manager.cc:362] Metadata directory not provided
14:00:07.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.452250 11048 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:07.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.452687 11048 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:07.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.455256 11048 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data/instance:
14:00:07.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f7a8f303ad6345588fb8138c7825b12e"
14:00:07.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:07 on dist-test-slave-c15h"
14:00:07.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.456236 11048 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal/instance:
14:00:07.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f7a8f303ad6345588fb8138c7825b12e"
14:00:07.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:07 on dist-test-slave-c15h"
14:00:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.462001 11048 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
14:00:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.465794 11065 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:07.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.467247 11048 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
14:00:07.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.467489 11048 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal
14:00:07.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f7a8f303ad6345588fb8138c7825b12e"
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:07 on dist-test-slave-c15h"
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.467741 11048 fs_report.cc:389] FS layout report
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data/data
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:07.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:07.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:07.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.483760 11048 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:07.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.484652 11048 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:07.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.484894 11048 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:07.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.506079 11116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.164.188:40835 every 8 connection(s)
14:00:07.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.506073 11048 rpc_server.cc:307] RPC server started. Bound to: 127.10.164.188:40835
14:00:07.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.508266 11048 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/data/info.pb
14:00:07.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.510659 10975 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 3
14:00:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.512367 10898 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11048
14:00:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.512562 10898 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/master-2/wal/instance
14:00:07.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.513612 11117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:07.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.522423 11117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.533504 10975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: Bootstrap starting.
14:00:07.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.538511 10975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: Neither blocks nor log segments found. Creating new log.
14:00:07.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.539418 11117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.541785 10975 log.cc:826] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: Log is configured to *not* fsync() on all Append() calls
14:00:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.545246 10975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: No bootstrap required, opened a new log
14:00:07.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.547190 11117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } has no permanent_uuid. Determining permanent_uuid...
14:00:07.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.551395 10975 raft_consensus.cc:359] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.552284 10975 raft_consensus.cc:385] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:07.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.552757 10975 raft_consensus.cc:740] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9036c34c96c4d5aaf4e511ea10c160e, State: Initialized, Role: FOLLOWER
14:00:07.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.553560 10975 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.554608 11125 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.554899 11125 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.555826 10975 sys_catalog.cc:565] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: configured and running, proceeding with master startup.
14:00:07.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.558041 11117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: Bootstrap starting.
14:00:07.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.564824 11117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: Neither blocks nor log segments found. Creating new log.
14:00:07.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.566932 11117 log.cc:826] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: Log is configured to *not* fsync() on all Append() calls
14:00:07.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.573290 11136 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:00:07.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.573999 11136 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:00:07.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.576985 11117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: No bootstrap required, opened a new log
14:00:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.582645 11117 raft_consensus.cc:359] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.583050 11117 raft_consensus.cc:385] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.583182 11117 raft_consensus.cc:740] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7a8f303ad6345588fb8138c7825b12e, State: Initialized, Role: FOLLOWER
14:00:07.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.568801 10909 master_runner.cc:187] Error getting master registration for 127.10.164.189:42291: OK, instance_id { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" instance_seqno: 1779112807028794 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:00:07.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.584810 11117 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.589423 10909 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:07.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.590117 11139 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.590489 11139 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.591573 11117 sys_catalog.cc:565] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: configured and running, proceeding with master startup.
14:00:07.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.603358 11150 catalog_manager.cc:1593] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:00:07.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.612330 11150 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:00:07.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.605768 11048 master_runner.cc:187] Error getting master registration for 127.10.164.189:42291: OK, instance_id { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" instance_seqno: 1779112807028794 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:00:07.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.613564 11048 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:07.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.736953 11071 tablet.cc:2404] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:07.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.744721 11046 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } attempt: 5
14:00:07.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.758800 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: Bootstrap starting.
14:00:07.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.763157 11046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: Neither blocks nor log segments found. Creating new log.
14:00:07.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.764562 11046 log.cc:826] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: Log is configured to *not* fsync() on all Append() calls
14:00:07.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.767954 11046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: No bootstrap required, opened a new log
14:00:07.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.776726 11046 raft_consensus.cc:359] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.777405 11125 raft_consensus.cc:493] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:00:07.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.777673 11125 raft_consensus.cc:515] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.778308 11046 raft_consensus.cc:385] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:07.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.778745 11046 raft_consensus.cc:740] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d85af2832f0046ccb37462d810c6ff96, State: Initialized, Role: FOLLOWER
14:00:07.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.779520 11125 leader_election.cc:290] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d85af2832f0046ccb37462d810c6ff96 (127.10.164.189:42291), f7a8f303ad6345588fb8138c7825b12e (127.10.164.188:40835)
14:00:07.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.781157 11092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a8f303ad6345588fb8138c7825b12e" is_pre_election: true
14:00:07.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.781744 11092 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9036c34c96c4d5aaf4e511ea10c160e in term 0.
14:00:07.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.782470 10924 leader_election.cc:304] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9036c34c96c4d5aaf4e511ea10c160e, f7a8f303ad6345588fb8138c7825b12e; no voters: 
14:00:07.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.782894 11046 consensus_queue.cc:260] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.783190 11125 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Leader pre-election won for term 1
14:00:07.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.783362 11125 raft_consensus.cc:493] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:00:07.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.783464 11125 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 0 FOLLOWER]: Advancing to term 1
14:00:07.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.786752 11125 raft_consensus.cc:515] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.788915 11092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7a8f303ad6345588fb8138c7825b12e"
14:00:07.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.789163 11092 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 0 FOLLOWER]: Advancing to term 1
14:00:07.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.793212 11092 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9036c34c96c4d5aaf4e511ea10c160e in term 1.
14:00:07.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.794365 10924 leader_election.cc:304] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9036c34c96c4d5aaf4e511ea10c160e, f7a8f303ad6345588fb8138c7825b12e; no voters: 
14:00:07.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.795864 11020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d85af2832f0046ccb37462d810c6ff96"
14:00:07.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.796409 11020 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 0 FOLLOWER]: Advancing to term 1
14:00:07.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.796296 11153 sys_catalog.cc:455] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.796612 11153 sys_catalog.cc:458] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.797142 11154 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 1 FOLLOWER]: Leader election won for term 1
14:00:07.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:07.799755 10929 tablet.cc:2404] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:07.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.800711 11046 sys_catalog.cc:565] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: configured and running, proceeding with master startup.
14:00:07.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.800681 11021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d85af2832f0046ccb37462d810c6ff96" is_pre_election: true
14:00:07.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.802244 11020 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9036c34c96c4d5aaf4e511ea10c160e in term 1.
14:00:07.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.802361 11125 leader_election.cc:290] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [CANDIDATE]: Term 1 election: Requested vote from peers d85af2832f0046ccb37462d810c6ff96 (127.10.164.189:42291), f7a8f303ad6345588fb8138c7825b12e (127.10.164.188:40835)
14:00:07.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.808501 11154 raft_consensus.cc:697] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [term 1 LEADER]: Becoming Leader. State: Replica: c9036c34c96c4d5aaf4e511ea10c160e, State: Running, Role: LEADER
14:00:07.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.809841 11154 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:07.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.825124 11125 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9036c34c96c4d5aaf4e511ea10c160e. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.825438 11125 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: This master's current role is: LEADER
14:00:07.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.838261 11162 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
14:00:07.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.841804 11162 catalog_manager.cc:1519] Initializing Kudu cluster ID...
14:00:07.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.862381 11092 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Refusing update from remote peer c9036c34c96c4d5aaf4e511ea10c160e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:07.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.864277 11125 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:07.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.877017 11020 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Refusing update from remote peer c9036c34c96c4d5aaf4e511ea10c160e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:07.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.878592 11125 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:07.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.885226 11139 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9036c34c96c4d5aaf4e511ea10c160e. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.885519 11139 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.890717 11166 mvcc.cc:204] Tried to move back new op lower bound from 7287246060992446464 to 7287246060795629568. Current Snapshot: MvccSnapshot[applied={T|T < 7287246060992446464}]
14:00:07.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.891280 11164 mvcc.cc:204] Tried to move back new op lower bound from 7287246060992446464 to 7287246060795629568. Current Snapshot: MvccSnapshot[applied={T|T < 7287246060992446464}]
14:00:07.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.904690 11153 sys_catalog.cc:455] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9036c34c96c4d5aaf4e511ea10c160e. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.904793 11139 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.905002 11139 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.905012 11153 sys_catalog.cc:458] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.907984 11170 mvcc.cc:204] Tried to move back new op lower bound from 7287246060992446464 to 7287246060795629568. Current Snapshot: MvccSnapshot[applied={T|T < 7287246060992446464}]
14:00:07.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.910449 11155 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.910856 11162 catalog_manager.cc:1382] Generated new cluster ID: 258b9efd77e242a0940eb57262451aae
14:00:07.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.910996 11162 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
14:00:07.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.910861 11155 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: This master's current role is: LEADER
14:00:07.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.910522 11125 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.911516 11125 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e [sys.catalog]: This master's current role is: LEADER
14:00:07.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.914167 11153 sys_catalog.cc:455] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:07.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.914390 11153 sys_catalog.cc:458] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: This master's current role is: FOLLOWER
14:00:07.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:07.923231 11176 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:00:08.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.002117 11162 catalog_manager.cc:1405] Generated new certificate authority record
14:00:08.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.004640 11162 catalog_manager.cc:1539] Loading token signing keys...
14:00:08.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.031360 11162 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c9036c34c96c4d5aaf4e511ea10c160e: Generated new TSK 0
14:00:08.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.033170 11162 catalog_manager.cc:1549] Initializing in-progress tserver states...
14:00:08.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.071966 10898 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:08.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:08.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal
14:00:08.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data
14:00:08.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/logs
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data/info.pb
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:08.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.129:0
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.164.129
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.129
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:08.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:00:08.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.423382 11177 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:08.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.423717 11177 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:08.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.423790 11177 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:08.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.432842 11177 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:08.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.433018 11177 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.164.129
14:00:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.443972 11177 tablet_server_runner.cc:78] Tablet server non-default flags:
14:00:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:08.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.129:0
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data/info.pb
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.129
14:00:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.164.129
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/logs
14:00:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:08.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.446070 11177 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:08.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.448015 11177 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:08.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.458170 11182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:08.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.458415 11183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:08.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.459860 11185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:08.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.460685 11177 server_base.cc:1061] running on GCE node
14:00:08.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.461241 11177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:08.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.462268 11177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:08.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.463496 11177 hybrid_clock.cc:648] HybridClock initialized: now 1779112808463438 us; error 51 us; skew 500 ppm
14:00:08.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.463910 11177 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:08.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.466509 11177 webserver.cc:533] Webserver started at http://127.10.164.129:34949/ using document root <none> and password file <none>
14:00:08.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.467573 11177 fs_manager.cc:362] Metadata directory not provided
14:00:08.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.467708 11177 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:08.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.468135 11177 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:08.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.470620 11177 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data/instance:
14:00:08.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1cb3bb2cce0c4e10bd99e0121fd37989"
14:00:08.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:08 on dist-test-slave-c15h"
14:00:08.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.471644 11177 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal/instance:
14:00:08.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1cb3bb2cce0c4e10bd99e0121fd37989"
14:00:08.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:08 on dist-test-slave-c15h"
14:00:08.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.477468 11177 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
14:00:08.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.481770 11191 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:08.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.483474 11177 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.483701 11177 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1cb3bb2cce0c4e10bd99e0121fd37989"
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:08 on dist-test-slave-c15h"
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.483953 11177 fs_report.cc:389] FS layout report
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal
14:00:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data/data
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:08.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:08.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.528132 11177 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:08.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.529331 11177 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:08.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.529671 11177 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:08.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.531076 11177 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:00:08.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.533329 11177 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:00:08.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.533480 11177 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:00:08.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.533604 11177 ts_tablet_manager.cc:616] Registered 0 tablets
14:00:08.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.533684 11177 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:00:08.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.569706 11177 rpc_server.cc:307] RPC server started. Bound to: 127.10.164.129:37549
14:00:08.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.569749 11303 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.164.129:37549 every 8 connection(s)
14:00:08.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.571210 11177 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/data/info.pb
14:00:08.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.573637 10898 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11177
14:00:08.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.573846 10898 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal/instance
14:00:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.587074 10898 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal
14:00:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data
14:00:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/logs
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data/info.pb
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.130:0
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.164.130
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.130
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:00:08.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.600029 11305 heartbeater.cc:344] Connected to a master server at 127.10.164.190:33575
14:00:08.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.600509 11305 heartbeater.cc:461] Registering TS with master...
14:00:08.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.601702 11305 heartbeater.cc:507] Master 127.10.164.190:33575 requested a full tablet report, sending...
14:00:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.604542 10939 ts_manager.cc:194] Registered new tserver with Master: 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549)
14:00:08.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.606722 10939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.164.129:52887
14:00:08.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.609401 11304 heartbeater.cc:344] Connected to a master server at 127.10.164.188:40835
14:00:08.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.609606 11304 heartbeater.cc:461] Registering TS with master...
14:00:08.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.610226 11304 heartbeater.cc:507] Master 127.10.164.188:40835 requested a full tablet report, sending...
14:00:08.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.612921 11082 ts_manager.cc:194] Registered new tserver with Master: 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549)
14:00:08.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.615459 11150 catalog_manager.cc:1294] Loaded cluster ID: 258b9efd77e242a0940eb57262451aae
14:00:08.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.615553 11150 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: loading cluster ID for follower catalog manager: success
14:00:08.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.618191 11306 heartbeater.cc:344] Connected to a master server at 127.10.164.189:42291
14:00:08.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.618404 11306 heartbeater.cc:461] Registering TS with master...
14:00:08.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.618781 11306 heartbeater.cc:507] Master 127.10.164.189:42291 requested a full tablet report, sending...
14:00:08.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.620119 11150 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: acquiring CA information for follower catalog manager: success
14:00:08.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.621093 11011 ts_manager.cc:194] Registered new tserver with Master: 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549)
14:00:08.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.622275 11150 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:00:08.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.929409 11176 catalog_manager.cc:1294] Loaded cluster ID: 258b9efd77e242a0940eb57262451aae
14:00:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.929567 11176 catalog_manager.cc:1587] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: loading cluster ID for follower catalog manager: success
14:00:08.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.933879 11176 catalog_manager.cc:1609] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: acquiring CA information for follower catalog manager: success
14:00:08.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.936908 11176 catalog_manager.cc:1637] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:00:08.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.944368 11312 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:08.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.944741 11312 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:08.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.944849 11312 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.953924 11312 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:08.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.954159 11312 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.164.130
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.964771 11312 tablet_server_runner.cc:78] Tablet server non-default flags:
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.130:0
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:08.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data/info.pb
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.130
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.164.130
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/logs
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:08.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:08.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.967069 11312 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:08.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.969002 11312 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.978993 11320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:08.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.979176 11319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:08.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:08.980860 11322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:08.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.981045 11312 server_base.cc:1061] running on GCE node
14:00:08.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.981868 11312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:08.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.983124 11312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:08.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.984679 11312 hybrid_clock.cc:648] HybridClock initialized: now 1779112808984546 us; error 119 us; skew 500 ppm
14:00:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.985096 11312 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:08.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.988346 11312 webserver.cc:533] Webserver started at http://127.10.164.130:38875/ using document root <none> and password file <none>
14:00:08.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.989362 11312 fs_manager.cc:362] Metadata directory not provided
14:00:08.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.989529 11312 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.989979 11312 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:08.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.992664 11312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data/instance:
14:00:08.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ebb5760ea0154e0daa03d275eac9ee41"
14:00:08.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:08 on dist-test-slave-c15h"
14:00:08.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.993585 11312 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal/instance:
14:00:08.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ebb5760ea0154e0daa03d275eac9ee41"
14:00:08.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:08 on dist-test-slave-c15h"
14:00:08.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:08.999166 11312 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
14:00:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.002774 11328 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.004225 11312 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
14:00:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.004482 11312 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal
14:00:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ebb5760ea0154e0daa03d275eac9ee41"
14:00:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:08 on dist-test-slave-c15h"
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.004735 11312 fs_report.cc:389] FS layout report
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data/data
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:09.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.039928 11312 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:09.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.041000 11312 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:09.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.041281 11312 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:09.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.043850 11312 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:00:09.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.046239 11312 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:00:09.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.046365 11312 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:00:09.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.046474 11312 ts_tablet_manager.cc:616] Registered 0 tablets
14:00:09.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.046543 11312 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:00:09.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.083263 11312 rpc_server.cc:307] RPC server started. Bound to: 127.10.164.130:37355
14:00:09.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.083348 11440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.164.130:37355 every 8 connection(s)
14:00:09.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.085153 11312 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/data/info.pb
14:00:09.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.095090 10898 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11312
14:00:09.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.095297 10898 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-1/wal/instance
14:00:09.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.099282 10898 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:09.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:09.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal
14:00:09.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data
14:00:09.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/logs
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data/info.pb
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:09.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.131:0
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.164.131
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.131
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:09.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:00:09.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.112989 11443 heartbeater.cc:344] Connected to a master server at 127.10.164.189:42291
14:00:09.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.113515 11443 heartbeater.cc:461] Registering TS with master...
14:00:09.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.114765 11443 heartbeater.cc:507] Master 127.10.164.189:42291 requested a full tablet report, sending...
14:00:09.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.116992 11011 ts_manager.cc:194] Registered new tserver with Master: ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355)
14:00:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.122087 11441 heartbeater.cc:344] Connected to a master server at 127.10.164.188:40835
14:00:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.122248 11441 heartbeater.cc:461] Registering TS with master...
14:00:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.122340 11442 heartbeater.cc:344] Connected to a master server at 127.10.164.190:33575
14:00:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.122505 11442 heartbeater.cc:461] Registering TS with master...
14:00:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.122900 11441 heartbeater.cc:507] Master 127.10.164.188:40835 requested a full tablet report, sending...
14:00:09.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.123196 11442 heartbeater.cc:507] Master 127.10.164.190:33575 requested a full tablet report, sending...
14:00:09.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.124138 10939 ts_manager.cc:194] Registered new tserver with Master: ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355)
14:00:09.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.125216 10939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.164.130:42777
14:00:09.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.126405 11082 ts_manager.cc:194] Registered new tserver with Master: ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355)
14:00:09.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.451367 11448 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:09.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.451692 11448 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:09.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.451766 11448 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.460608 11448 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:09.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.460775 11448 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.164.131
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.470952 11448 tablet_server_runner.cc:78] Tablet server non-default flags:
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.164.148:32777
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.164.131:0
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data/info.pb
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.164.131
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.164.190:33575,127.10.164.189:42291,127.10.164.188:40835
14:00:09.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.164.131
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/logs
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:09.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:09.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:09.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:09.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:09.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.472587 11448 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:09.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.475380 11448 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:09.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.489102 11456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:09.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.489152 11454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:09.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:09.489044 11453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:09.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.495083 11448 server_base.cc:1061] running on GCE node
14:00:09.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.495985 11448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:09.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.497313 11448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:09.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.498620 11448 hybrid_clock.cc:648] HybridClock initialized: now 1779112809498512 us; error 59 us; skew 500 ppm
14:00:09.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.499080 11448 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.501850 11448 webserver.cc:533] Webserver started at http://127.10.164.131:35759/ using document root <none> and password file <none>
14:00:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.502755 11448 fs_manager.cc:362] Metadata directory not provided
14:00:09.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.502902 11448 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:09.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.503304 11448 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:09.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.506004 11448 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data/instance:
14:00:09.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ba8b63f7d4674e438c2c5db01f26b061"
14:00:09.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:09 on dist-test-slave-c15h"
14:00:09.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.506788 11448 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal/instance:
14:00:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ba8b63f7d4674e438c2c5db01f26b061"
14:00:09.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:09 on dist-test-slave-c15h"
14:00:09.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.513222 11448 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
14:00:09.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.517232 11462 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:09.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.518713 11448 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.518863 11448 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ba8b63f7d4674e438c2c5db01f26b061"
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:09 on dist-test-slave-c15h"
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.519105 11448 fs_report.cc:389] FS layout report
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data/data
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:09.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:09.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.538232 11448 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:09.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.539198 11448 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:09.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.539451 11448 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:09.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.540391 11448 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:00:09.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.542192 11448 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:00:09.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.542281 11448 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:00:09.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.542358 11448 ts_tablet_manager.cc:616] Registered 0 tablets
14:00:09.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.542456 11448 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:00:09.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.582219 11448 rpc_server.cc:307] RPC server started. Bound to: 127.10.164.131:38341
14:00:09.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.582294 11574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.164.131:38341 every 8 connection(s)
14:00:09.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.583644 11448 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/data/info.pb
14:00:09.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.593109 10898 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11448
14:00:09.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.593299 10898 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal/instance
14:00:09.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.602468 11577 heartbeater.cc:344] Connected to a master server at 127.10.164.189:42291
14:00:09.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.602914 11577 heartbeater.cc:461] Registering TS with master...
14:00:09.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.603871 11577 heartbeater.cc:507] Master 127.10.164.189:42291 requested a full tablet report, sending...
14:00:09.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.604692 11575 heartbeater.cc:344] Connected to a master server at 127.10.164.188:40835
14:00:09.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.604802 11575 heartbeater.cc:461] Registering TS with master...
14:00:09.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.605269 11575 heartbeater.cc:507] Master 127.10.164.188:40835 requested a full tablet report, sending...
14:00:09.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.605638 11011 ts_manager.cc:194] Registered new tserver with Master: ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:09.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.606474 11082 ts_manager.cc:194] Registered new tserver with Master: ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:09.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.606916 11576 heartbeater.cc:344] Connected to a master server at 127.10.164.190:33575
14:00:09.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.607081 11576 heartbeater.cc:461] Registering TS with master...
14:00:09.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.607487 11576 heartbeater.cc:507] Master 127.10.164.190:33575 requested a full tablet report, sending...
14:00:09.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.608503 10939 ts_manager.cc:194] Registered new tserver with Master: ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:09.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.609292 10939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.164.131:60155
14:00:09.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.610737 11305 heartbeater.cc:499] Master 127.10.164.190:33575 was elected leader, sending a full tablet report...
14:00:09.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:09.619995 10898 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:00:09.622 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:00:09.623 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:00:09.633 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.164.190"
      port: 33575
    }
    bound_http_address {
      host: "127.10.164.190"
      port: 37685
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.164.189"
      port: 42291
    }
    bound_http_address {
      host: "127.10.164.189"
      port: 46849
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.164.188"
      port: 40835
    }
    bound_http_address {
      host: "127.10.164.188"
      port: 43241
    }
  }
}

14:00:09.637 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:00:09.640 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.164.129"
      port: 37549
    }
    bound_http_address {
      host: "127.10.164.129"
      port: 34949
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.164.130"
      port: 37355
    }
    bound_http_address {
      host: "127.10.164.130"
      port: 38875
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.164.131"
      port: 38341
    }
    bound_http_address {
      host: "127.10.164.131"
      port: 35759
    }
  }
}

14:00:09.640 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:00:09.811 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
14:00:09.870 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:00:10.016 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:10.070 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.164.188:40835(127.10.164.188:40835)] connecting to peer
14:00:10.072 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.10.164.189:42291(127.10.164.189:42291)] connecting to peer
14:00:10.089 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.164.188:40835(127.10.164.188:40835)] Successfully connected to peer
14:00:10.089 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.164.189:42291(127.10.164.189:42291)] Successfully connected to peer
14:00:10.089 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.164.190:33575(127.10.164.190:33575)] Successfully connected to peer
14:00:10.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.128818 11442 heartbeater.cc:499] Master 127.10.164.190:33575 was elected leader, sending a full tablet report...
14:00:10.204 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.164.189
14:00:10.204 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.164.188
14:00:10.207 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.10.164.190
14:00:10.425 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x6753c721, L:/127.0.0.1:45564 - R:/127.10.164.189:42291] using SASL/PLAIN
14:00:10.425 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x1ff1a9a8, L:/127.0.0.1:39400 - R:/127.10.164.190:33575] using SASL/PLAIN
14:00:10.425 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe2a5e977, L:/127.0.0.1:42308 - R:/127.10.164.188:40835] using SASL/PLAIN
14:00:10.462 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:00:10.463 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=488), Traces: [0ms] refreshing cache from master, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [461ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [461ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: OK, [461ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, deferred=null) after lookup
14:00:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.514571 10939 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39400:
14:00:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
14:00:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:00:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:00:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:00:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:00:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:10.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:00:10.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:00:10.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:00:10.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:10.517093 10939 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:00:10.572 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 27a6cfc773174f9baa4dcb8262804269
14:00:10.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.607332 11239 tablet_service.cc:1511] Processing CreateTablet for tablet 58e994c54f3f4c83af57ac957a12b315 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269]), partition=RANGE (key) PARTITION UNBOUNDED
14:00:10.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.608973 11239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e994c54f3f4c83af57ac957a12b315. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:10.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.614465 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 58e994c54f3f4c83af57ac957a12b315 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269]), partition=RANGE (key) PARTITION UNBOUNDED
14:00:10.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.615921 11576 heartbeater.cc:499] Master 127.10.164.190:33575 was elected leader, sending a full tablet report...
14:00:10.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.616943 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e994c54f3f4c83af57ac957a12b315. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:10.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.612003 11376 tablet_service.cc:1511] Processing CreateTablet for tablet 58e994c54f3f4c83af57ac957a12b315 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269]), partition=RANGE (key) PARTITION UNBOUNDED
14:00:10.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.619225 11376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e994c54f3f4c83af57ac957a12b315. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:10.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.622552 11605 tablet_bootstrap.cc:492] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Bootstrap starting.
14:00:10.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.629163 11605 tablet_bootstrap.cc:654] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Neither blocks nor log segments found. Creating new log.
14:00:10.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.630498 11605 log.cc:826] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Log is configured to *not* fsync() on all Append() calls
14:00:10.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.633893 11605 tablet_bootstrap.cc:492] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: No bootstrap required, opened a new log
14:00:10.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.634227 11605 ts_tablet_manager.cc:1403] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.003s
14:00:10.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.634910 11607 tablet_bootstrap.cc:492] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Bootstrap starting.
14:00:10.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.638983 11607 tablet_bootstrap.cc:654] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Neither blocks nor log segments found. Creating new log.
14:00:10.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.639021 11608 tablet_bootstrap.cc:492] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: Bootstrap starting.
14:00:10.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.640920 11607 log.cc:826] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Log is configured to *not* fsync() on all Append() calls
14:00:10.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.641914 11605 raft_consensus.cc:359] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.642318 11605 raft_consensus.cc:385] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:10.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.642426 11605 raft_consensus.cc:740] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb3bb2cce0c4e10bd99e0121fd37989, State: Initialized, Role: FOLLOWER
14:00:10.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.642684 11608 tablet_bootstrap.cc:654] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: Neither blocks nor log segments found. Creating new log.
14:00:10.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.643170 11605 consensus_queue.cc:260] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.643894 11607 tablet_bootstrap.cc:492] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: No bootstrap required, opened a new log
14:00:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.644198 11608 log.cc:826] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: Log is configured to *not* fsync() on all Append() calls
14:00:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.644484 11607 ts_tablet_manager.cc:1403] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.002s
14:00:10.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.645089 11605 ts_tablet_manager.cc:1434] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
14:00:10.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.651276 11608 tablet_bootstrap.cc:492] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: No bootstrap required, opened a new log
14:00:10.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.651620 11608 ts_tablet_manager.cc:1403] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
14:00:10.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.655484 11607 raft_consensus.cc:359] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.655848 11607 raft_consensus.cc:385] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:10.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.655951 11607 raft_consensus.cc:740] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8b63f7d4674e438c2c5db01f26b061, State: Initialized, Role: FOLLOWER
14:00:10.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.656539 11608 raft_consensus.cc:359] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.656721 11607 consensus_queue.cc:260] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.657585 11608 raft_consensus.cc:385] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:10.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.657864 11608 raft_consensus.cc:740] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb5760ea0154e0daa03d275eac9ee41, State: Initialized, Role: FOLLOWER
14:00:10.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.658499 11607 ts_tablet_manager.cc:1434] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
14:00:10.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.658663 11608 consensus_queue.cc:260] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.664829 11608 ts_tablet_manager.cc:1434] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
14:00:10.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.717379 11613 raft_consensus.cc:493] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:00:10.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.717694 11613 raft_consensus.cc:515] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.719900 11613 leader_election.cc:290] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549), ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:10.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.726534 11610 raft_consensus.cc:493] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:00:10.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.726856 11610 raft_consensus.cc:515] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.728925 11530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "ebb5760ea0154e0daa03d275eac9ee41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba8b63f7d4674e438c2c5db01f26b061" is_pre_election: true
14:00:10.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.728925 11259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "ebb5760ea0154e0daa03d275eac9ee41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" is_pre_election: true
14:00:10.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.729317 11610 leader_election.cc:290] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355), ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:10.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.729405 11259 raft_consensus.cc:2468] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb5760ea0154e0daa03d275eac9ee41 in term 0.
14:00:10.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.729444 11530 raft_consensus.cc:2468] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebb5760ea0154e0daa03d275eac9ee41 in term 0.
14:00:10.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.730218 11332 leader_election.cc:304] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb3bb2cce0c4e10bd99e0121fd37989, ebb5760ea0154e0daa03d275eac9ee41; no voters: 
14:00:10.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.731070 11613 raft_consensus.cc:2804] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:00:10.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.731218 11613 raft_consensus.cc:493] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:00:10.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.731326 11613 raft_consensus.cc:3060] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 0 FOLLOWER]: Advancing to term 1
14:00:10.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.734336 11613 raft_consensus.cc:515] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.735044 11613 leader_election.cc:290] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [CANDIDATE]: Term 1 election: Requested vote from peers 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549), ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:10.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.735872 11259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "ebb5760ea0154e0daa03d275eac9ee41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989"
14:00:10.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.735860 11530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "ebb5760ea0154e0daa03d275eac9ee41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba8b63f7d4674e438c2c5db01f26b061"
14:00:10.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.736073 11530 raft_consensus.cc:3060] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 0 FOLLOWER]: Advancing to term 1
14:00:10.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.736064 11259 raft_consensus.cc:3060] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 0 FOLLOWER]: Advancing to term 1
14:00:10.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.738969 11529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba8b63f7d4674e438c2c5db01f26b061" is_pre_election: true
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.739136 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb5760ea0154e0daa03d275eac9ee41" is_pre_election: true
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.739428 11530 raft_consensus.cc:2468] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb5760ea0154e0daa03d275eac9ee41 in term 1.
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.739498 11259 raft_consensus.cc:2468] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ebb5760ea0154e0daa03d275eac9ee41 in term 1.
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.739619 11396 raft_consensus.cc:2393] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cb3bb2cce0c4e10bd99e0121fd37989 in current term 1: Already voted for candidate ebb5760ea0154e0daa03d275eac9ee41 in this term.
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.740000 11332 leader_election.cc:304] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb3bb2cce0c4e10bd99e0121fd37989, ebb5760ea0154e0daa03d275eac9ee41; no voters: 
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.740495 11613 raft_consensus.cc:2804] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 1 FOLLOWER]: Leader election won for term 1
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.740475 11195 leader_election.cc:304] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cb3bb2cce0c4e10bd99e0121fd37989; no voters: ba8b63f7d4674e438c2c5db01f26b061, ebb5760ea0154e0daa03d275eac9ee41
14:00:10.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.740809 11610 raft_consensus.cc:2749] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
14:00:10.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.741245 11613 raft_consensus.cc:697] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [term 1 LEADER]: Becoming Leader. State: Replica: ebb5760ea0154e0daa03d275eac9ee41, State: Running, Role: LEADER
14:00:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.741801 11613 consensus_queue.cc:237] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:10.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.747438 10939 catalog_manager.cc:5696] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 reported cstate change: term changed from 0 to 1, leader changed from <none> to ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130). New cstate: current_term: 1 leader_uuid: "ebb5760ea0154e0daa03d275eac9ee41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } health_report { overall_health: UNKNOWN } } }
14:00:10.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 27a6cfc773174f9baa4dcb8262804269
14:00:10.803 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 58e994c54f3f4c83af57ac957a12b315 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:00:10.809 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299994, tablet=58e994c54f3f4c83af57ac957a12b315@[1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549),ba8b63f7d4674e438c2c5db01f26b061(127.10.164.131:38341),ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)[L]]}]
14:00:10.810 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=18), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.190:33575, [9ms] Sub RPC GetTableLocations: received response from server master-127.10.164.190:33575: OK, deferred=null) after lookup
14:00:10.820 [DEBUG - kudu-nio-0] (Connection.java:748) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] connecting to peer
14:00:10.822 [DEBUG - kudu-nio-3] (Connection.java:757) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] Successfully connected to peer
14:00:10.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:10.835279 11311 tablet.cc:2404] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:10.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:10.837586 11578 tablet.cc:2404] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:10.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:10.850838 11444 tablet.cc:2404] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:10.885 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x70a33325, L:/127.0.0.1:33556 - R:/127.10.164.130:37355] using TOKEN/null
14:00:10.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.895656 11530 raft_consensus.cc:1275] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 1 FOLLOWER]: Refusing update from remote peer ebb5760ea0154e0daa03d275eac9ee41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:10.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.895717 11259 raft_consensus.cc:1275] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Refusing update from remote peer ebb5760ea0154e0daa03d275eac9ee41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:10.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.896692 11618 consensus_queue.cc:1048] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:10.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:10.897177 11613 consensus_queue.cc:1048] T 58e994c54f3f4c83af57ac957a12b315 P ebb5760ea0154e0daa03d275eac9ee41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:11.134 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=58e994c54f3f4c83af57ac957a12b315, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:00:11.136 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.10.164.190:33575
14:00:11.137 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

14:00:11.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:11.138103 10898 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 10909
14:00:11.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:11.139539 10970 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:11.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:11.257681 10898 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 10909
14:00:11.282 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:00:11.283 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.10.164.130:37355
14:00:11.283 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

14:00:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:11.283830 10898 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11312
14:00:11.284 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.164.190:33575(127.10.164.190:33575)] handling channelInactive
14:00:11.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state READY due to: connection closed
14:00:11.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:11.291975 11436 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:11.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:11.403439 10898 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11312
14:00:11.424 [DEBUG - kudu-nio-3] (Connection.java:239) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] handling channelInactive
14:00:11.424 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:00:11.425 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] cleaning up while in state READY due to: connection closed
14:00:11.425 [DEBUG - Time-limited test] (Connection.java:748) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] connecting to peer
14:00:11.427 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:11.428 [DEBUG - kudu-nio-4] (Connection.java:709) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] cleaning up while in state CONNECTING due to: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:11.428 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355) for tablet 58e994c54f3f4c83af57ac957a12b315: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:11.437 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.439 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.439 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.439 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.10.164.190:33575(127.10.164.190:33575) for tablet Kudu Master: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.457 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.461 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.461 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.462 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.464 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.477 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.480 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.480 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.480 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.481 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.497 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.498 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.498 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.499 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.501 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.537 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.539 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.539 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.540 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.541 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.577 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.578 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.578 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.579 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.582 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.637 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.639 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.639 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.639 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.641 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.677 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.678 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.679 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.680 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.697 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.698 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.698 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.699 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.701 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.716 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:11.718 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.718 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.719 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:11.721 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:11.963069 11305 heartbeater.cc:646] Failed to heartbeat to 127.10.164.190:33575 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111)
14:00:11.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:11.964608 11576 heartbeater.cc:646] Failed to heartbeat to 127.10.164.190:33575 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111)
14:00:12.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.255184 11642 raft_consensus.cc:493] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9036c34c96c4d5aaf4e511ea10c160e)
14:00:12.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.255435 11642 raft_consensus.cc:515] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:12.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.256786 11642 leader_election.cc:290] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575), f7a8f303ad6345588fb8138c7825b12e (127.10.164.188:40835)
14:00:12.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.257439 11091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d85af2832f0046ccb37462d810c6ff96" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f7a8f303ad6345588fb8138c7825b12e" is_pre_election: true
14:00:12.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.257849 10997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111) [suppressed 4 similar messages]
14:00:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.259344 10997 leader_election.cc:336] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575): Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111)
14:00:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.259512 10997 leader_election.cc:304] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d85af2832f0046ccb37462d810c6ff96; no voters: c9036c34c96c4d5aaf4e511ea10c160e, f7a8f303ad6345588fb8138c7825b12e
14:00:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.259950 11642 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:00:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.571002 11645 raft_consensus.cc:493] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ebb5760ea0154e0daa03d275eac9ee41)
14:00:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.571245 11645 raft_consensus.cc:515] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.572019 11646 raft_consensus.cc:493] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ebb5760ea0154e0daa03d275eac9ee41)
14:00:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.572155 11645 leader_election.cc:290] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355), ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.572494 11646 raft_consensus.cc:515] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:12.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.576624 11646 leader_election.cc:290] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549), ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355)
14:00:12.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.577121 11466 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111)
14:00:12.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.577478 11195 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111)
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.578447 11529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "ba8b63f7d4674e438c2c5db01f26b061" is_pre_election: true
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.578730 11529 raft_consensus.cc:2468] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cb3bb2cce0c4e10bd99e0121fd37989 in term 1.
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.578965 11466 leader_election.cc:336] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355): Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111)
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.579146 11195 leader_election.cc:336] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355): Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111)
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.579452 11195 leader_election.cc:304] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb3bb2cce0c4e10bd99e0121fd37989, ba8b63f7d4674e438c2c5db01f26b061; no voters: ebb5760ea0154e0daa03d275eac9ee41
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.579720 11645 raft_consensus.cc:2804] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:00:12.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.579845 11645 raft_consensus.cc:493] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ebb5760ea0154e0daa03d275eac9ee41)
14:00:12.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.579924 11645 raft_consensus.cc:3060] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 1 FOLLOWER]: Advancing to term 2
14:00:12.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.582801 11645 raft_consensus.cc:515] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:12.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.583442 11645 leader_election.cc:290] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 2 election: Requested vote from peers ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355), ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341)
14:00:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.583720 11259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "ba8b63f7d4674e438c2c5db01f26b061" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" is_pre_election: true
14:00:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.584003 11259 raft_consensus.cc:2393] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba8b63f7d4674e438c2c5db01f26b061 in current term 2: Already voted for candidate 1cb3bb2cce0c4e10bd99e0121fd37989 in this term.
14:00:12.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.584748 11466 leader_election.cc:304] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba8b63f7d4674e438c2c5db01f26b061; no voters: 1cb3bb2cce0c4e10bd99e0121fd37989, ebb5760ea0154e0daa03d275eac9ee41
14:00:12.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.585326 11646 raft_consensus.cc:3060] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 1 FOLLOWER]: Advancing to term 2
14:00:12.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.585829 11529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e994c54f3f4c83af57ac957a12b315" candidate_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "ba8b63f7d4674e438c2c5db01f26b061"
14:00:12.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.586179 11195 leader_election.cc:336] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355): Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111)
14:00:12.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.588474 11646 raft_consensus.cc:2749] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:00:12.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.591357 11529 raft_consensus.cc:2468] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cb3bb2cce0c4e10bd99e0121fd37989 in term 2.
14:00:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.592212 11195 leader_election.cc:304] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cb3bb2cce0c4e10bd99e0121fd37989, ba8b63f7d4674e438c2c5db01f26b061; no voters: ebb5760ea0154e0daa03d275eac9ee41
14:00:12.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.592546 11645 raft_consensus.cc:2804] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 2 FOLLOWER]: Leader election won for term 2
14:00:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.593003 11645 raft_consensus.cc:697] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 2 LEADER]: Becoming Leader. State: Replica: 1cb3bb2cce0c4e10bd99e0121fd37989, State: Running, Role: LEADER
14:00:12.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.593566 11645 consensus_queue.cc:237] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } }
14:00:12.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.615633 11048 master_runner.cc:187] Error getting master registration for 127.10.164.190:33575: Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111), 
14:00:12.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.615862 11048 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:12.637 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:12.639 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:12.639 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:12.639 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.640108 11656 raft_consensus.cc:493] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9036c34c96c4d5aaf4e511ea10c160e)
14:00:12.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.640580 11656 raft_consensus.cc:515] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:12.642 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291; will retry
14:00:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.643128 11068 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111)
14:00:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.643200 11021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7a8f303ad6345588fb8138c7825b12e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d85af2832f0046ccb37462d810c6ff96" is_pre_election: true
14:00:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.643481 11021 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7a8f303ad6345588fb8138c7825b12e in term 1.
14:00:12.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.643813 11656 leader_election.cc:290] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575), d85af2832f0046ccb37462d810c6ff96 (127.10.164.189:42291)
14:00:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.644064 11066 leader_election.cc:304] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d85af2832f0046ccb37462d810c6ff96, f7a8f303ad6345588fb8138c7825b12e; no voters: 
14:00:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.644445 11656 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Leader pre-election won for term 2
14:00:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.644558 11656 raft_consensus.cc:493] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9036c34c96c4d5aaf4e511ea10c160e)
14:00:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.644666 11656 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 1 FOLLOWER]: Advancing to term 2
14:00:12.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.646595 11656 raft_consensus.cc:515] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:12.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.647492 11656 leader_election.cc:290] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [CANDIDATE]: Term 2 election: Requested vote from peers c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575), d85af2832f0046ccb37462d810c6ff96 (127.10.164.189:42291)
14:00:12.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.648028 11021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7a8f303ad6345588fb8138c7825b12e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d85af2832f0046ccb37462d810c6ff96"
14:00:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.648155 11068 leader_election.cc:336] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575): Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111)
14:00:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.648245 11021 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 1 FOLLOWER]: Advancing to term 2
14:00:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.649236 11068 leader_election.cc:336] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575): Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111)
14:00:12.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.650472 11021 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7a8f303ad6345588fb8138c7825b12e in term 2.
14:00:12.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.650900 11066 leader_election.cc:304] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d85af2832f0046ccb37462d810c6ff96, f7a8f303ad6345588fb8138c7825b12e; no voters: c9036c34c96c4d5aaf4e511ea10c160e
14:00:12.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.651264 11656 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 2 FOLLOWER]: Leader election won for term 2
14:00:12.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.651758 11656 raft_consensus.cc:697] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [term 2 LEADER]: Becoming Leader. State: Replica: f7a8f303ad6345588fb8138c7825b12e, State: Running, Role: LEADER
14:00:12.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.652165 11656 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } }
14:00:12.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.653842 11658 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7a8f303ad6345588fb8138c7825b12e. Latest consensus state: current_term: 2 leader_uuid: "f7a8f303ad6345588fb8138c7825b12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:12.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.654161 11658 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: This master's current role is: LEADER
14:00:12.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.654829 11660 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
14:00:12.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.657251 11660 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269]
14:00:12.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.659039 11660 tablet_loader.cc:96] loaded metadata for tablet 58e994c54f3f4c83af57ac957a12b315 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269])
14:00:12.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.659364 11660 catalog_manager.cc:1519] Initializing Kudu cluster ID...
14:00:12.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.660233 11660 catalog_manager.cc:1294] Loaded cluster ID: 258b9efd77e242a0940eb57262451aae
14:00:12.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.660334 11660 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
14:00:12.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.661511 11660 catalog_manager.cc:1539] Loading token signing keys...
14:00:12.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.662370 11660 catalog_manager.cc:6080] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: Loaded TSK: 0
14:00:12.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:12.663355 11660 catalog_manager.cc:1549] Initializing in-progress tserver states...
14:00:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:12.984118 11195 consensus_peers.cc:597] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 -> Peer ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355): Couldn't send request to peer ebb5760ea0154e0daa03d275eac9ee41. Status: Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:00:13.077 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.10.164.190:33575(127.10.164.190:33575)] connecting to peer
14:00:13.078 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:13.079 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.164.190:33575(127.10.164.190:33575)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:13.079 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.10.164.190:33575: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575
14:00:13.082 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:00:13.085 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=29989, elapsed=1646), Traces: [0ms] sending RPC to server master-127.10.164.190:33575, [3ms] received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [25ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [29ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [41ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [44ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [45ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [63ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [65ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [65ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [101ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [104ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [105ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [105ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [143ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [144ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [146ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [201ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [203ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [205ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [205ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [206ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [243ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [244ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [244ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [245ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [260ms] refreshing cache from master, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [262ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [264ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [265ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [280ms] refreshing cache from master, [280ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [283ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [284ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [284ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [285ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1200ms] refreshing cache from master, [1201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1203ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1206ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1206ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1206ms] delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1640ms] refreshing cache from master, [1641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1642ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1643ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1645ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1646ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, deferred=Deferred@415264221(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@710799475 after retry RPC after error@444584316) -> (continuation of Deferred@393962659 after retry RPC after error@206462228) -> (continuation of Deferred@1230367366 after retry RPC after error@759510753) -> (continuation of Deferred@1633096086 after retry RPC after error@529483349) -> (continuation of Deferred@2045288184 after retry RPC after error@2099141914) -> (continuation of Deferred@605825166 after retry RPC after error@1103392694) -> (continuation of Deferred@2095461928 after retry RPC after error@1939821091) -> (continuation of Deferred@914513030 after retry RPC after error@1423522879) -> (continuation of Deferred@423823354 after retry RPC after error@281297083) -> (continuation of Deferred@881219657 after retry RPC after error@698593826), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@710799475 after retry RPC after error@444584316) -> (continuation of Deferred@393962659 after retry RPC after error@206462228) -> (continuation of Deferred@1230367366 after retry RPC after error@759510753) -> (continuation of Deferred@1633096086 after retry RPC after error@529483349) -> (continuation of Deferred@2045288184 after retry RPC after error@2099141914) -> (continuation of Deferred@605825166 after retry RPC after error@1103392694) -> (continuation of Deferred@2095461928 after retry RPC after error@1939821091) -> (continuation of Deferred@914513030 after retry RPC after error@1423522879) -> (continuation of Deferred@423823354 after retry RPC after error@281297083) -> (continuation of Deferred@881219657 after retry RPC after error@698593826))) after lookup
14:00:13.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.088845 11021 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [term 2 FOLLOWER]: Refusing update from remote peer f7a8f303ad6345588fb8138c7825b12e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
14:00:13.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.089752 11658 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
14:00:13.091 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 58e994c54f3f4c83af57ac957a12b315 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:00:13.092 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=58e994c54f3f4c83af57ac957a12b315@[1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549),ba8b63f7d4674e438c2c5db01f26b061(127.10.164.131:38341),ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)[L]]}]
14:00:13.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.092947 11661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7a8f303ad6345588fb8138c7825b12e. Latest consensus state: current_term: 2 leader_uuid: "f7a8f303ad6345588fb8138c7825b12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:13.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.093236 11661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: This master's current role is: FOLLOWER
14:00:13.096 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=58e994c54f3f4c83af57ac957a12b315, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1667), Traces: [0ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [3ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [3ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [11ms] refreshing cache from master, [11ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.190:33575, [14ms] Sub RPC GetTableLocations: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [15ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [31ms] Sub RPC GetTableLocations: refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [40ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [55ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [71ms] Sub RPC GetTableLocations: refreshing cache from master, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [74ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [76ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [112ms] Sub RPC GetTableLocations: refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [115ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [116ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [151ms] Sub RPC GetTableLocations: refreshing cache from master, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [212ms] Sub RPC GetTableLocations: refreshing cache from master, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [251ms] Sub RPC GetTableLocations: refreshing cache from master, [251ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [254ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [256ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [271ms] Sub RPC GetTableLocations: refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [273ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [276ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [291ms] Sub RPC GetTableLocations: refreshing cache from master, [291ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [294ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [296ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1211ms] Sub RPC GetTableLocations: refreshing cache from master, [1212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1651ms] Sub RPC GetTableLocations: refreshing cache from master, [1652ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1654ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1656ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1657ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1661ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.188:40835, [1666ms] Sub RPC GetTableLocations: received response from server master-127.10.164.188:40835: OK, deferred=Deferred@447561731(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@1c6f170f -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@28e99402 -> wakeup thread Time-limited test)) after lookup
14:00:13.098 [DEBUG - kudu-nio-1] (Connection.java:748) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] connecting to peer
14:00:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.100271 11661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f7a8f303ad6345588fb8138c7825b12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:13.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.100534 11661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d85af2832f0046ccb37462d810c6ff96 [sys.catalog]: This master's current role is: FOLLOWER
14:00:13.102 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.102 [DEBUG - kudu-nio-1] (Connection.java:709) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] cleaning up while in state CONNECTING due to: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.103 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355) for tablet 58e994c54f3f4c83af57ac957a12b315: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.103843 11656 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f7a8f303ad6345588fb8138c7825b12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9036c34c96c4d5aaf4e511ea10c160e" member_type: VOTER last_known_addr { host: "127.10.164.190" port: 33575 } } peers { permanent_uuid: "d85af2832f0046ccb37462d810c6ff96" member_type: VOTER last_known_addr { host: "127.10.164.189" port: 42291 } } peers { permanent_uuid: "f7a8f303ad6345588fb8138c7825b12e" member_type: VOTER last_known_addr { host: "127.10.164.188" port: 40835 } } }
14:00:13.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.104179 11656 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e [sys.catalog]: This master's current role is: LEADER
14:00:13.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:13.105275 11068 consensus_peers.cc:597] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e -> Peer c9036c34c96c4d5aaf4e511ea10c160e (127.10.164.190:33575): Couldn't send request to peer c9036c34c96c4d5aaf4e511ea10c160e. Status: Network error: Client connection negotiation failed: client connection to 127.10.164.190:33575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:00:13.120 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 58e994c54f3f4c83af57ac957a12b315 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:00:13.121 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=58e994c54f3f4c83af57ac957a12b315@[1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549),ba8b63f7d4674e438c2c5db01f26b061(127.10.164.131:38341),ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)[L]]}]
14:00:13.122 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=58e994c54f3f4c83af57ac957a12b315, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1696), Traces: [0ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [3ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [3ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [11ms] refreshing cache from master, [11ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.190:33575, [14ms] Sub RPC GetTableLocations: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [15ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [31ms] Sub RPC GetTableLocations: refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [40ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [55ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [71ms] Sub RPC GetTableLocations: refreshing cache from master, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [74ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [76ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [112ms] Sub RPC GetTableLocations: refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [115ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [116ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [151ms] Sub RPC GetTableLocations: refreshing cache from master, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [212ms] Sub RPC GetTableLocations: refreshing cache from master, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [251ms] Sub RPC GetTableLocations: refreshing cache from master, [251ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [254ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [256ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [271ms] Sub RPC GetTableLocations: refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [273ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [276ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [291ms] Sub RPC GetTableLocations: refreshing cache from master, [291ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [294ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [296ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1211ms] Sub RPC GetTableLocations: refreshing cache from master, [1212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1651ms] Sub RPC GetTableLocations: refreshing cache from master, [1652ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1654ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1656ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1657ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1661ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.188:40835, [1666ms] Sub RPC GetTableLocations: received response from server master-127.10.164.188:40835: OK, [1673ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [1677ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1678ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1691ms] refreshing cache from master, [1692ms] too many traces: truncated at 100 traces, deferred=Deferred@447561731(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@1c6f170f -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@28e99402 -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849))) after lookup
14:00:13.124 [DEBUG - kudu-nio-1] (Connection.java:748) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] connecting to peer
14:00:13.125 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.125 [DEBUG - kudu-nio-2] (Connection.java:709) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] cleaning up while in state CONNECTING due to: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.125 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355) for tablet 58e994c54f3f4c83af57ac957a12b315: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.160 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 58e994c54f3f4c83af57ac957a12b315 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:00:13.160 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=58e994c54f3f4c83af57ac957a12b315@[1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549),ba8b63f7d4674e438c2c5db01f26b061(127.10.164.131:38341),ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)[L]]}]
14:00:13.161 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=58e994c54f3f4c83af57ac957a12b315, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1736), Traces: [0ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [3ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [3ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [11ms] refreshing cache from master, [11ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.190:33575, [14ms] Sub RPC GetTableLocations: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [15ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [31ms] Sub RPC GetTableLocations: refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [40ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [55ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [71ms] Sub RPC GetTableLocations: refreshing cache from master, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [74ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [76ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [112ms] Sub RPC GetTableLocations: refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [115ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [116ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [151ms] Sub RPC GetTableLocations: refreshing cache from master, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [212ms] Sub RPC GetTableLocations: refreshing cache from master, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [251ms] Sub RPC GetTableLocations: refreshing cache from master, [251ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [254ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [256ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [271ms] Sub RPC GetTableLocations: refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [273ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [276ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [291ms] Sub RPC GetTableLocations: refreshing cache from master, [291ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [294ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [296ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1211ms] Sub RPC GetTableLocations: refreshing cache from master, [1212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1651ms] Sub RPC GetTableLocations: refreshing cache from master, [1652ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1654ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1656ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1657ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1661ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.188:40835, [1666ms] Sub RPC GetTableLocations: received response from server master-127.10.164.188:40835: OK, [1673ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [1677ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1678ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1691ms] refreshing cache from master, [1692ms] too many traces: truncated at 100 traces, deferred=Deferred@447561731(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@1c6f170f -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849) -> (continuation of Deferred@368770146 after retry RPC@204088471), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@28e99402 -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849) -> (continuation of Deferred@368770146 after retry RPC@204088471))) after lookup
14:00:13.163 [DEBUG - kudu-nio-1] (Connection.java:748) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] connecting to peer
14:00:13.164 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.164 [DEBUG - kudu-nio-3] (Connection.java:709) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] cleaning up while in state CONNECTING due to: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.164 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355) for tablet 58e994c54f3f4c83af57ac957a12b315: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.169270 11529 raft_consensus.cc:1275] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 2 FOLLOWER]: Refusing update from remote peer 1cb3bb2cce0c4e10bd99e0121fd37989: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
14:00:13.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.170071 11645 consensus_queue.cc:1048] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
14:00:13.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.171747 11575 heartbeater.cc:499] Master 127.10.164.188:40835 was elected leader, sending a full tablet report...
14:00:13.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.174744 11082 catalog_manager.cc:5696] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 reported cstate change: term changed from 1 to 2, leader changed from ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130) to 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129). New cstate: current_term: 2 leader_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cb3bb2cce0c4e10bd99e0121fd37989" member_type: VOTER last_known_addr { host: "127.10.164.129" port: 37549 } } peers { permanent_uuid: "ebb5760ea0154e0daa03d275eac9ee41" member_type: VOTER last_known_addr { host: "127.10.164.130" port: 37355 } } peers { permanent_uuid: "ba8b63f7d4674e438c2c5db01f26b061" member_type: VOTER last_known_addr { host: "127.10.164.131" port: 38341 } } }
14:00:13.181 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 58e994c54f3f4c83af57ac957a12b315 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:00:13.181 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=58e994c54f3f4c83af57ac957a12b315@[1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549),ba8b63f7d4674e438c2c5db01f26b061(127.10.164.131:38341),ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)[L]]}]
14:00:13.183 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=58e994c54f3f4c83af57ac957a12b315, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1757), Traces: [0ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [3ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [3ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [11ms] refreshing cache from master, [11ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.190:33575, [14ms] Sub RPC GetTableLocations: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [15ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [31ms] Sub RPC GetTableLocations: refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [40ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [55ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [71ms] Sub RPC GetTableLocations: refreshing cache from master, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [74ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [76ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [112ms] Sub RPC GetTableLocations: refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [115ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [116ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [151ms] Sub RPC GetTableLocations: refreshing cache from master, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [212ms] Sub RPC GetTableLocations: refreshing cache from master, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [251ms] Sub RPC GetTableLocations: refreshing cache from master, [251ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [254ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [256ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [271ms] Sub RPC GetTableLocations: refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [273ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [276ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [291ms] Sub RPC GetTableLocations: refreshing cache from master, [291ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [294ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [296ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1211ms] Sub RPC GetTableLocations: refreshing cache from master, [1212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1651ms] Sub RPC GetTableLocations: refreshing cache from master, [1652ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1654ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1656ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1657ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1661ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.188:40835, [1666ms] Sub RPC GetTableLocations: received response from server master-127.10.164.188:40835: OK, [1673ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [1677ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1678ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1691ms] refreshing cache from master, [1692ms] too many traces: truncated at 100 traces, deferred=Deferred@447561731(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@1c6f170f -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849) -> (continuation of Deferred@368770146 after retry RPC@204088471) -> (continuation of Deferred@1460123157 after retry RPC@173289214), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@28e99402 -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849) -> (continuation of Deferred@368770146 after retry RPC@204088471) -> (continuation of Deferred@1460123157 after retry RPC@173289214))) after lookup
14:00:13.184 [DEBUG - kudu-nio-1] (Connection.java:748) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] connecting to peer
14:00:13.185 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.186 [DEBUG - kudu-nio-4] (Connection.java:709) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] cleaning up while in state CONNECTING due to: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.186 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355) for tablet 58e994c54f3f4c83af57ac957a12b315: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355
14:00:13.660 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 58e994c54f3f4c83af57ac957a12b315 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:00:13.660 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=58e994c54f3f4c83af57ac957a12b315@[1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549)[L],ba8b63f7d4674e438c2c5db01f26b061(127.10.164.131:38341),ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)]}]
14:00:13.661 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=58e994c54f3f4c83af57ac957a12b315, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2235), Traces: [0ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [3ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [3ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [11ms] refreshing cache from master, [11ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.190:33575, [14ms] Sub RPC GetTableLocations: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [15ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [31ms] Sub RPC GetTableLocations: refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [36ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [40ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [55ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [71ms] Sub RPC GetTableLocations: refreshing cache from master, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [74ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [76ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [112ms] Sub RPC GetTableLocations: refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [115ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [116ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [151ms] Sub RPC GetTableLocations: refreshing cache from master, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [154ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [155ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [212ms] Sub RPC GetTableLocations: refreshing cache from master, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [251ms] Sub RPC GetTableLocations: refreshing cache from master, [251ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [254ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [255ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [256ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [271ms] Sub RPC GetTableLocations: refreshing cache from master, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [273ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [275ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [276ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [291ms] Sub RPC GetTableLocations: refreshing cache from master, [291ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [292ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [294ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [295ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [296ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1211ms] Sub RPC GetTableLocations: refreshing cache from master, [1212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1214ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1217ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.10.164.190:33575,127.10.164.188:40835,127.10.164.189:42291) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1651ms] Sub RPC GetTableLocations: refreshing cache from master, [1652ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.190:33575, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.188:40835, [1653ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.164.189:42291, [1654ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.190:33575: Network error: Failed to connect to peer master-127.10.164.190:33575(127.10.164.190:33575): Connection refused: /127.10.164.190:33575, [1656ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.189:42291: OK, [1657ms] Sub RPC ConnectToMaster: received response from server master-127.10.164.188:40835: OK, [1661ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.164.188:40835, [1666ms] Sub RPC GetTableLocations: received response from server master-127.10.164.188:40835: OK, [1673ms] sending RPC to server ebb5760ea0154e0daa03d275eac9ee41, [1677ms] received response from server ebb5760ea0154e0daa03d275eac9ee41: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1678ms] delaying RPC due to: Network error: Failed to connect to peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355): Connection refused: /127.10.164.130:37355, [1691ms] refreshing cache from master, [1692ms] too many traces: truncated at 100 traces, deferred=Deferred@447561731(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@1c6f170f -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849) -> (continuation of Deferred@368770146 after retry RPC@204088471) -> (continuation of Deferred@1460123157 after retry RPC@173289214) -> (continuation of Deferred@1846178458 after retry RPC@1166185083), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@28e99402 -> wakeup thread Time-limited test -> (continuation of Deferred@415264221 after retry RPC@118741849) -> (continuation of Deferred@368770146 after retry RPC@204088471) -> (continuation of Deferred@1460123157 after retry RPC@173289214) -> (continuation of Deferred@1846178458 after retry RPC@1166185083))) after lookup
14:00:13.662 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549)] connecting to peer
14:00:13.669 [DEBUG - kudu-nio-5] (Connection.java:757) [peer 1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549)] Successfully connected to peer
14:00:13.708 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xe70ba01b, L:/127.0.0.1:44118 - R:/127.10.164.129:37549] using TOKEN/null
14:00:13.830 [DEBUG - kudu-nio-5] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=58e994c54f3f4c83af57ac957a12b315, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:00:13.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.835238 11081 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42308:
14:00:13.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
14:00:13.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.835546 11081 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42308:
14:00:13.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
14:00:13.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.848555 11081 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f7a8f303ad6345588fb8138c7825b12e: Sending DeleteTablet for 3 replicas of tablet 58e994c54f3f4c83af57ac957a12b315
14:00:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:13.853381 11069 catalog_manager.cc:4754] TS ebb5760ea0154e0daa03d275eac9ee41 (127.10.164.130:37355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 58e994c54f3f4c83af57ac957a12b315: Network error: Client connection negotiation failed: client connection to 127.10.164.130:37355: connect: Connection refused (error 111)
14:00:13.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.859057 11239 tablet_service.cc:1558] Processing DeleteTablet for tablet 58e994c54f3f4c83af57ac957a12b315 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 14:00:13 UTC) from {username='slave'} at 127.0.0.1:44120
14:00:13.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.866966 11510 tablet_service.cc:1558] Processing DeleteTablet for tablet 58e994c54f3f4c83af57ac957a12b315 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 14:00:13 UTC) from {username='slave'} at 127.0.0.1:38776
14:00:13.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.870338 11693 tablet_replica.cc:333] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: stopping tablet replica
14:00:13.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.871140 11693 raft_consensus.cc:2243] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 2 LEADER]: Raft consensus shutting down.
14:00:13.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.872051 11693 raft_consensus.cc:2272] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989 [term 2 FOLLOWER]: Raft consensus is shut down!
14:00:13.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.874979 11693 ts_tablet_manager.cc:1916] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Deleting tablet data with delete state TABLET_DATA_DELETED
14:00:13.875 [DEBUG - main] (Connection.java:575) [peer master-127.10.164.188:40835(127.10.164.188:40835)] disconnecting while in state READY
14:00:13.876 [DEBUG - main] (Connection.java:575) [peer 1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549)] disconnecting while in state READY
14:00:13.877 [DEBUG - main] (Connection.java:575) [peer ebb5760ea0154e0daa03d275eac9ee41(127.10.164.130:37355)] disconnecting while in state TERMINATED
14:00:13.877 [DEBUG - main] (Connection.java:575) [peer master-127.10.164.189:42291(127.10.164.189:42291)] disconnecting while in state READY
14:00:13.880 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.164.189:42291(127.10.164.189:42291)] handling channelInactive
14:00:13.881 [DEBUG - kudu-nio-5] (Connection.java:239) [peer 1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549)] handling channelInactive
14:00:13.881 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 1cb3bb2cce0c4e10bd99e0121fd37989(127.10.164.129:37549)] cleaning up while in state READY due to: connection closed
14:00:13.881 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.164.189:42291(127.10.164.189:42291)] cleaning up while in state READY due to: connection closed
14:00:13.882 [DEBUG - main] (Connection.java:575) [peer master-127.10.164.190:33575(127.10.164.190:33575)] disconnecting while in state TERMINATED
14:00:13.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.882838 11694 tablet_replica.cc:333] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: stopping tablet replica
14:00:13.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.883358 11694 raft_consensus.cc:2243] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 2 FOLLOWER]: Raft consensus shutting down.
14:00:13.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.883993 11694 raft_consensus.cc:2272] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061 [term 2 FOLLOWER]: Raft consensus is shut down!
14:00:13.884 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:00:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.886720 11694 ts_tablet_manager.cc:1916] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Deleting tablet data with delete state TABLET_DATA_DELETED
14:00:13.891 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.164.188:40835(127.10.164.188:40835)] handling channelInactive
14:00:13.892 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.164.188:40835(127.10.164.188:40835)] cleaning up while in state READY due to: connection closed
14:00:13.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.892946 10898 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11177
14:00:13.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.895557 11694 ts_tablet_manager.cc:1929] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
14:00:13.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.895893 11694 log.cc:1199] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Deleting WAL directory at /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-2/wal/wals/58e994c54f3f4c83af57ac957a12b315
14:00:13.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.896634 11694 ts_tablet_manager.cc:1950] T 58e994c54f3f4c83af57ac957a12b315 P ba8b63f7d4674e438c2c5db01f26b061: Deleting consensus metadata
14:00:13.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.897471 11693 ts_tablet_manager.cc:1929] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
14:00:13.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.898144 11693 log.cc:1199] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Deleting WAL directory at /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster2814849402824032750/ts-0/wal/wals/58e994c54f3f4c83af57ac957a12b315
14:00:13.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.898802 11069 catalog_manager.cc:5027] TS ba8b63f7d4674e438c2c5db01f26b061 (127.10.164.131:38341): tablet 58e994c54f3f4c83af57ac957a12b315 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269]) successfully deleted
14:00:13.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.899121 11693 ts_tablet_manager.cc:1950] T 58e994c54f3f4c83af57ac957a12b315 P 1cb3bb2cce0c4e10bd99e0121fd37989: Deleting consensus metadata
14:00:13.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.900929 11069 catalog_manager.cc:5027] TS 1cb3bb2cce0c4e10bd99e0121fd37989 (127.10.164.129:37549): tablet 58e994c54f3f4c83af57ac957a12b315 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=27a6cfc773174f9baa4dcb8262804269]) successfully deleted
14:00:13.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:13.915876 11299 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:14.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.027912 10898 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11177
14:00:14.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.048128 10898 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11448
14:00:14.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.055159 11570 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:14.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.151319 10898 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11448
14:00:14.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.169024 10898 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 10977
14:00:14.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.170503 11041 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:14.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.279038 10898 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 10977
14:00:14.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.299059 10898 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11048
14:00:14.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.300283 11112 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:14.412333 10898 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11048
14:00:14.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:00:14Z chronyd exiting
.14:00:14.781 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779112814781
14:00:14.785 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:00:14.786 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:00:14.786 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task78Poou/test-tmp
14:00:14.786 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
14:00:14.787 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task78Poou/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
14:00:14.790 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:00:15.134 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:00:15.134 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:00:15.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.137130 11704 mini_oidc.cc:150] Starting JWKS server
14:00:15.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.139380 11704 webserver.cc:533] Webserver started at http://127.0.0.1:46671/ using document root <none> and password file <none>
14:00:15.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.139611 11704 mini_oidc.cc:186] Starting OIDC Discovery server
14:00:15.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.140086 11704 webserver.cc:533] Webserver started at http://127.0.0.1:38373/ using document root <none> and password file <none>
14:00:15.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:00:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:00:15.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:00:15Z Disabled control of system clock
14:00:15.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.168694 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/logs
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/info.pb
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.62:41937
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.62
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:15.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json with env {}
14:00:15.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.504928 11715 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:15.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.505270 11715 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:15.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.505347 11715 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.514353 11715 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.514456 11715 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.514508 11715 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.514556 11715 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:15.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.514611 11715 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:15.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.514643 11715 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46671/jwks.json
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.525596 11715 master_runner.cc:387] Master server non-default flags:
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:15.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.62:41937
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/info.pb
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.62
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/logs
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:15.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:15.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:15.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:15.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:15.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.527606 11715 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:15.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.529628 11715 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:15.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.539274 11721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:15.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.539382 11720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:15.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.539336 11723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:15.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.539613 11715 server_base.cc:1061] running on GCE node
14:00:15.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.541009 11715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:15.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.542471 11715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:15.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.543736 11715 hybrid_clock.cc:648] HybridClock initialized: now 1779112815543655 us; error 57 us; skew 500 ppm
14:00:15.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.544179 11715 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:15.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.546774 11715 webserver.cc:533] Webserver started at http://127.11.110.62:45925/ using document root <none> and password file <none>
14:00:15.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.547626 11715 fs_manager.cc:362] Metadata directory not provided
14:00:15.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.547776 11715 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:15.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.548169 11715 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.550625 11715 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/instance:
14:00:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82adaae36e1248559e30afdb3cdb0bdd"
14:00:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:15 on dist-test-slave-c15h"
14:00:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.551575 11715 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal/instance:
14:00:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82adaae36e1248559e30afdb3cdb0bdd"
14:00:15.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:15 on dist-test-slave-c15h"
14:00:15.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.557238 11715 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
14:00:15.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.560884 11729 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:15.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.562299 11715 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
14:00:15.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.562520 11715 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82adaae36e1248559e30afdb3cdb0bdd"
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:15 on dist-test-slave-c15h"
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.562788 11715 fs_report.cc:389] FS layout report
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/data
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:15.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.602082 11715 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:15.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.603180 11715 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:15.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.603529 11715 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:15.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.626119 11715 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.62:41937
14:00:15.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.626159 11780 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.62:41937 every 8 connection(s)
14:00:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.627940 11715 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/info.pb
14:00:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.632588 11781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.637256 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11715
14:00:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.637598 11704 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal/instance
14:00:15.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.638600 11781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } has no permanent_uuid. Determining permanent_uuid...
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.640082 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/logs
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data/info.pb
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:15.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.61:33299
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.61
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:15.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:15.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:15.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json with env {}
14:00:15.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.657429 11781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } has no permanent_uuid. Determining permanent_uuid...
14:00:15.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.658550 11732 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.110.61:33299: connect: Connection refused (error 111)
14:00:15.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.660254 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.61:33299: Network error: Client connection negotiation failed: client connection to 127.11.110.61:33299: connect: Connection refused (error 111)
14:00:15.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.709697 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } attempt: 1
14:00:15.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.712343 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.61:33299: Network error: Client connection negotiation failed: client connection to 127.11.110.61:33299: connect: Connection refused (error 111)
14:00:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.780673 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } attempt: 2
14:00:15.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.784904 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.61:33299: Network error: Client connection negotiation failed: client connection to 127.11.110.61:33299: connect: Connection refused (error 111)
14:00:15.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.876180 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } attempt: 3
14:00:15.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.878011 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.61:33299: Network error: Client connection negotiation failed: client connection to 127.11.110.61:33299: connect: Connection refused (error 111)
14:00:15.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.974073 11785 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:15.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.974408 11785 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:15.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.974486 11785 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:15.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.983528 11785 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.983639 11785 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.983693 11785 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.983734 11785 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.983793 11785 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:15.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:15.983827 11785 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46671/jwks.json
14:00:15.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:15.997654 11785 master_runner.cc:387] Master server non-default flags:
14:00:15.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:15.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:15.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.61:33299
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data/info.pb
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.61
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:15.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/logs
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:16.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.000160 11785 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:16.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.002336 11785 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:16.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.011657 11792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:16.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.012080 11794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:16.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.011687 11791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:16.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.013823 11785 server_base.cc:1061] running on GCE node
14:00:16.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.014778 11785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:16.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.016369 11785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:16.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.017660 11785 hybrid_clock.cc:648] HybridClock initialized: now 1779112816017597 us; error 48 us; skew 500 ppm
14:00:16.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.018181 11785 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:16.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.020809 11785 webserver.cc:533] Webserver started at http://127.11.110.61:35795/ using document root <none> and password file <none>
14:00:16.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.021281 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } attempt: 4
14:00:16.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.021829 11785 fs_manager.cc:362] Metadata directory not provided
14:00:16.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.021939 11785 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:16.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.022446 11785 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:16.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.023761 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.61:33299: Network error: Client connection negotiation failed: client connection to 127.11.110.61:33299: connect: Connection refused (error 111)
14:00:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.025601 11785 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data/instance:
14:00:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "85fd3897dce24b7a82b1544b233e546b"
14:00:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:16 on dist-test-slave-c15h"
14:00:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.026470 11785 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal/instance:
14:00:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "85fd3897dce24b7a82b1544b233e546b"
14:00:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:16 on dist-test-slave-c15h"
14:00:16.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.032245 11785 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
14:00:16.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.036105 11800 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.037942 11785 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.038123 11785 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "85fd3897dce24b7a82b1544b233e546b"
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:16 on dist-test-slave-c15h"
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.038321 11785 fs_report.cc:389] FS layout report
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data/data
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:16.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:16.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.064838 11785 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:16.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.065737 11785 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.065985 11785 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:16.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.087677 11785 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.61:33299
14:00:16.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.087684 11851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.61:33299 every 8 connection(s)
14:00:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.089267 11785 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/data/info.pb
14:00:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.090417 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11785
14:00:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.090596 11704 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-1/wal/instance
14:00:16.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.091681 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:16.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/logs
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data/info.pb
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:16.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.60:41117
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.60
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:16.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json with env {}
14:00:16.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.095108 11852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:16.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.105062 11852 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.120414 11852 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.130703 11852 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.131927 11803 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.133491 11852 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.182847 11852 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 1
14:00:16.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.184970 11852 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.253253 11852 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 2
14:00:16.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.255574 11852 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.323102 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } attempt: 5
14:00:16.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.330415 11781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.332290 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.346844 11852 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 3
14:00:16.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.349239 11852 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.383540 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 1
14:00:16.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.385588 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.446115 11854 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.446461 11854 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:16.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.446547 11854 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.453863 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 2
14:00:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.455724 11854 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:16.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.455850 11854 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:16.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.455930 11854 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:16.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.455986 11854 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:16.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.456012 11781 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.456060 11854 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:16.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.456115 11854 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46671/jwks.json
14:00:16.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.467507 11854 master_runner.cc:387] Master server non-default flags:
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.60:41117
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data/info.pb
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.60
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:16.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/logs
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:16.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.469885 11854 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:16.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.472093 11854 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:16.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.481031 11863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:16.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.481035 11862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:16.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.481554 11865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:16.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.482647 11854 server_base.cc:1061] running on GCE node
14:00:16.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.483613 11854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:16.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.485116 11854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.486389 11854 hybrid_clock.cc:648] HybridClock initialized: now 1779112816486320 us; error 52 us; skew 500 ppm
14:00:16.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.486867 11854 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:16.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.489362 11854 webserver.cc:533] Webserver started at http://127.11.110.60:43711/ using document root <none> and password file <none>
14:00:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.490187 11854 fs_manager.cc:362] Metadata directory not provided
14:00:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.490326 11854 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:16.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.490794 11854 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:16.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.492472 11852 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 4
14:00:16.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.493350 11854 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data/instance:
14:00:16.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06451373b8084aeaa21024d122b2af2f"
14:00:16.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:16 on dist-test-slave-c15h"
14:00:16.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.494210 11852 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.110.60:41117: Network error: Client connection negotiation failed: client connection to 127.11.110.60:41117: connect: Connection refused (error 111)
14:00:16.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.494302 11854 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal/instance:
14:00:16.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06451373b8084aeaa21024d122b2af2f"
14:00:16.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:16 on dist-test-slave-c15h"
14:00:16.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.499872 11854 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
14:00:16.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.503469 11871 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.504842 11854 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.505034 11854 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06451373b8084aeaa21024d122b2af2f"
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:16 on dist-test-slave-c15h"
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.505280 11854 fs_report.cc:389] FS layout report
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data/data
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:16.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:16.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:16.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:16.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:16.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:16.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:16.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:16.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.530736 11854 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:16.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.531847 11854 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:16.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.532189 11854 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.553505 11854 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.60:41117
14:00:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.553565 11922 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.60:41117 every 8 connection(s)
14:00:16.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.555215 11854 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/data/info.pb
14:00:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.559425 11923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:16.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.562122 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11854
14:00:16.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.562253 11781 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 3
14:00:16.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.562357 11704 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-2/wal/instance
14:00:16.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.566948 11923 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.581848 11923 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.585374 11781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Bootstrap starting.
14:00:16.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.590324 11781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Neither blocks nor log segments found. Creating new log.
14:00:16.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.592490 11781 log.cc:826] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Log is configured to *not* fsync() on all Append() calls
14:00:16.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.593345 11923 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } has no permanent_uuid. Determining permanent_uuid...
14:00:16.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.596529 11781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: No bootstrap required, opened a new log
14:00:16.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.603734 11781 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:16.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.603964 11923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: Bootstrap starting.
14:00:16.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.604049 11781 raft_consensus.cc:385] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:16.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.604163 11781 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82adaae36e1248559e30afdb3cdb0bdd, State: Initialized, Role: FOLLOWER
14:00:16.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.604815 11781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:16.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.605829 11932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:16.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.606289 11932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: FOLLOWER
14:00:16.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.607219 11781 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: configured and running, proceeding with master startup.
14:00:16.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.607829 11923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: Neither blocks nor log segments found. Creating new log.
14:00:16.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.608915 11923 log.cc:826] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: Log is configured to *not* fsync() on all Append() calls
14:00:16.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.612694 11923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: No bootstrap required, opened a new log
14:00:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.620329 11944 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:00:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.620255 11923 raft_consensus.cc:359] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.620630 11923 raft_consensus.cc:385] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:16.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.620774 11923 raft_consensus.cc:740] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06451373b8084aeaa21024d122b2af2f, State: Initialized, Role: FOLLOWER
14:00:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.621040 11944 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:00:16.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.621600 11923 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:16.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.622584 11946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:16.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.623080 11946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: This master's current role is: FOLLOWER
14:00:16.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.623847 11923 sys_catalog.cc:565] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: configured and running, proceeding with master startup.
14:00:16.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.635821 11854 master_runner.cc:187] Error getting master registration for 127.11.110.61:33299: OK, instance_id { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" instance_seqno: 1779112816081901 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:00:16.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.621704 11715 master_runner.cc:187] Error getting master registration for 127.11.110.61:33299: OK, instance_id { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" instance_seqno: 1779112816081901 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:00:16.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.641979 11854 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:16.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.642453 11715 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:16.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.649850 11957 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:00:16.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.650234 11957 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:00:16.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.784595 11877 tablet.cc:2404] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:16.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.793469 11852 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } attempt: 5
14:00:16.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.803429 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: Bootstrap starting.
14:00:16.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.806599 11852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: Neither blocks nor log segments found. Creating new log.
14:00:16.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.807770 11852 log.cc:826] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: Log is configured to *not* fsync() on all Append() calls
14:00:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.812744 11852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: No bootstrap required, opened a new log
14:00:16.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.817960 11852 raft_consensus.cc:359] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:16.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.818300 11852 raft_consensus.cc:385] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:16.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.818418 11852 raft_consensus.cc:740] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fd3897dce24b7a82b1544b233e546b, State: Initialized, Role: FOLLOWER
14:00:16.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.819307 11852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:16.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.820418 11960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.820922 11960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: This master's current role is: FOLLOWER
14:00:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.821735 11852 sys_catalog.cc:565] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: configured and running, proceeding with master startup.
14:00:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.840811 11785 master_runner.cc:264] No leader master found from master 85fd3897dce24b7a82b1544b233e546b
14:00:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:16.841004 11785 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.844491 11971 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:00:16.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.844944 11971 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:00:16.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:16.857523 11735 tablet.cc:2404] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.045202 11932 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:00:17.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.045518 11932 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:17.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.047900 11932 leader_election.cc:290] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85fd3897dce24b7a82b1544b233e546b (127.11.110.61:33299), 06451373b8084aeaa21024d122b2af2f (127.11.110.60:41117)
14:00:17.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.049212 11898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82adaae36e1248559e30afdb3cdb0bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06451373b8084aeaa21024d122b2af2f" is_pre_election: true
14:00:17.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.049767 11898 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82adaae36e1248559e30afdb3cdb0bdd in term 0.
14:00:17.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.050719 11827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82adaae36e1248559e30afdb3cdb0bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fd3897dce24b7a82b1544b233e546b" is_pre_election: true
14:00:17.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.051255 11827 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82adaae36e1248559e30afdb3cdb0bdd in term 0.
14:00:17.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.052024 11732 leader_election.cc:304] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06451373b8084aeaa21024d122b2af2f, 82adaae36e1248559e30afdb3cdb0bdd; no voters: 
14:00:17.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.053407 11932 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Leader pre-election won for term 1
14:00:17.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.053561 11932 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:00:17.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.053659 11932 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 0 FOLLOWER]: Advancing to term 1
14:00:17.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.057632 11932 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:17.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.059581 11827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82adaae36e1248559e30afdb3cdb0bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fd3897dce24b7a82b1544b233e546b"
14:00:17.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.059808 11827 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 0 FOLLOWER]: Advancing to term 1
14:00:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.063432 11827 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82adaae36e1248559e30afdb3cdb0bdd in term 1.
14:00:17.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.064023 11732 leader_election.cc:304] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82adaae36e1248559e30afdb3cdb0bdd, 85fd3897dce24b7a82b1544b233e546b; no voters: 
14:00:17.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.067041 11932 leader_election.cc:290] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [CANDIDATE]: Term 1 election: Requested vote from peers 85fd3897dce24b7a82b1544b233e546b (127.11.110.61:33299), 06451373b8084aeaa21024d122b2af2f (127.11.110.60:41117)
14:00:17.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.068953 11806 tablet.cc:2404] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:17.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.071058 11932 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 1 FOLLOWER]: Leader election won for term 1
14:00:17.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.071376 11932 raft_consensus.cc:697] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 1 LEADER]: Becoming Leader. State: Replica: 82adaae36e1248559e30afdb3cdb0bdd, State: Running, Role: LEADER
14:00:17.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.071969 11932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:17.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.074222 11898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82adaae36e1248559e30afdb3cdb0bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06451373b8084aeaa21024d122b2af2f"
14:00:17.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.074477 11898 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 0 FOLLOWER]: Advancing to term 1
14:00:17.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.077965 11898 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82adaae36e1248559e30afdb3cdb0bdd in term 1.
14:00:17.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.088488 11973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82adaae36e1248559e30afdb3cdb0bdd. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.088806 11973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: LEADER
14:00:17.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.100497 11975 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
14:00:17.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.103197 11975 catalog_manager.cc:1519] Initializing Kudu cluster ID...
14:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.123813 11898 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 1 FOLLOWER]: Refusing update from remote peer 82adaae36e1248559e30afdb3cdb0bdd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.125970 11973 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:17.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.136003 11827 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Refusing update from remote peer 82adaae36e1248559e30afdb3cdb0bdd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:17.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.137326 11973 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.164335 11977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82adaae36e1248559e30afdb3cdb0bdd. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.164654 11977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: This master's current role is: FOLLOWER
14:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.166045 11978 mvcc.cc:204] Tried to move back new op lower bound from 7287246098907951104 to 7287246098742366208. Current Snapshot: MvccSnapshot[applied={T|T < 7287246098907951104}]
14:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.166632 11976 mvcc.cc:204] Tried to move back new op lower bound from 7287246098907951104 to 7287246098742366208. Current Snapshot: MvccSnapshot[applied={T|T < 7287246098907951104}]
14:00:17.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.171979 11977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.172226 11977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: This master's current role is: FOLLOWER
14:00:17.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.177930 11960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82adaae36e1248559e30afdb3cdb0bdd. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.178232 11960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: This master's current role is: FOLLOWER
14:00:17.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.185248 11932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.185604 11932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: LEADER
14:00:17.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.186378 11932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.186592 11932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: LEADER
14:00:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.187829 11975 catalog_manager.cc:1382] Generated new cluster ID: aa59f109da3b494cba2deb5dd64c9a72
14:00:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.187935 11975 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
14:00:17.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.200788 11960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82adaae36e1248559e30afdb3cdb0bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:17.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.201033 11960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: This master's current role is: FOLLOWER
14:00:17.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.217689 11975 catalog_manager.cc:1405] Generated new certificate authority record
14:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.219877 11975 catalog_manager.cc:1539] Loading token signing keys...
14:00:17.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.233353 11975 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Generated new TSK 0
14:00:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.234887 11975 catalog_manager.cc:1549] Initializing in-progress tserver states...
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.251802 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/logs
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data/info.pb
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:17.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.1:0
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.110.1
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.1
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:00:17.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.598803 11985 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:17.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.599135 11985 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:17.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.599206 11985 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:17.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.607851 11985 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:17.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.608039 11985 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.110.1
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.618600 11985 tablet_server_runner.cc:78] Tablet server non-default flags:
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.1:0
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data/info.pb
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.1
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.110.1
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/logs
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:17.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:17.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:17.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.620316 11985 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:17.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.622215 11985 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:17.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.632444 11990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:17.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.634105 11991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:17.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:17.635048 11993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:17.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.635212 11985 server_base.cc:1061] running on GCE node
14:00:17.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.635900 11985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:17.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.636871 11985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:17.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.638109 11985 hybrid_clock.cc:648] HybridClock initialized: now 1779112817638063 us; error 41 us; skew 500 ppm
14:00:17.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.638460 11985 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:17.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.640784 11985 webserver.cc:533] Webserver started at http://127.11.110.1:38193/ using document root <none> and password file <none>
14:00:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.641597 11985 fs_manager.cc:362] Metadata directory not provided
14:00:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.641736 11985 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:17.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.642127 11985 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.644924 11985 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data/instance:
14:00:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f62192dc767a42f394dbbc99f972e058"
14:00:17.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:17 on dist-test-slave-c15h"
14:00:17.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.645831 11985 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal/instance:
14:00:17.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f62192dc767a42f394dbbc99f972e058"
14:00:17.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:17 on dist-test-slave-c15h"
14:00:17.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.651556 11985 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
14:00:17.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.652354 11957 catalog_manager.cc:1294] Loaded cluster ID: aa59f109da3b494cba2deb5dd64c9a72
14:00:17.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.652462 11957 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: loading cluster ID for follower catalog manager: success
14:00:17.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.655196 11999 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:17.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.655421 11957 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: acquiring CA information for follower catalog manager: success
14:00:17.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.656735 11985 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.656973 11985 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f62192dc767a42f394dbbc99f972e058"
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:17 on dist-test-slave-c15h"
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.657346 11957 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.657238 11985 fs_report.cc:389] FS layout report
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data/data
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:17.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:17.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:17.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:17.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.679386 11985 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:17.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.680397 11985 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:17.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.680748 11985 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.681875 11985 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:00:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.683748 11985 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:00:17.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.683880 11985 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:00:17.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.683990 11985 ts_tablet_manager.cc:616] Registered 0 tablets
14:00:17.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.684067 11985 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:00:17.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.719306 11985 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.1:40033
14:00:17.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.719409 12111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.1:40033 every 8 connection(s)
14:00:17.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.720947 11985 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/data/info.pb
14:00:17.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.731474 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 11985
14:00:17.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.731742 11704 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-0/wal/instance
14:00:17.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.740440 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:17.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:17.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal
14:00:17.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/logs
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data/info.pb
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.2:0
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.110.2
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.2
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:17.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:17.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:17.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:17.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:00:17.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.745554 12113 heartbeater.cc:344] Connected to a master server at 127.11.110.62:41937
14:00:17.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.746119 12113 heartbeater.cc:461] Registering TS with master...
14:00:17.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.747432 12113 heartbeater.cc:507] Master 127.11.110.62:41937 requested a full tablet report, sending...
14:00:17.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.750586 11745 ts_manager.cc:194] Registered new tserver with Master: f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:17.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.753252 11745 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.110.1:52899
14:00:17.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.753988 12112 heartbeater.cc:344] Connected to a master server at 127.11.110.60:41117
14:00:17.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.754138 12112 heartbeater.cc:461] Registering TS with master...
14:00:17.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.754747 12112 heartbeater.cc:507] Master 127.11.110.60:41117 requested a full tablet report, sending...
14:00:17.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.756918 11888 ts_manager.cc:194] Registered new tserver with Master: f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.760227 12114 heartbeater.cc:344] Connected to a master server at 127.11.110.61:33299
14:00:17.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.760392 12114 heartbeater.cc:461] Registering TS with master...
14:00:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.760856 12114 heartbeater.cc:507] Master 127.11.110.61:33299 requested a full tablet report, sending...
14:00:17.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.762836 11817 ts_manager.cc:194] Registered new tserver with Master: f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.847038 11971 catalog_manager.cc:1294] Loaded cluster ID: aa59f109da3b494cba2deb5dd64c9a72
14:00:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.847162 11971 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: loading cluster ID for follower catalog manager: success
14:00:17.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.849826 11971 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: acquiring CA information for follower catalog manager: success
14:00:17.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:17.851706 11971 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:00:18.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.104697 12122 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:18.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.105095 12122 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:18.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.105175 12122 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:18.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.114305 12122 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:18.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.114511 12122 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.110.2
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.126829 12122 tablet_server_runner.cc:78] Tablet server non-default flags:
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.2:0
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data/info.pb
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.2
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:18.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.110.2
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/logs
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:18.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.128700 12122 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.130671 12122 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:18.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.140697 12128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:18.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.140750 12127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:18.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.140901 12130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:18.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.141994 12122 server_base.cc:1061] running on GCE node
14:00:18.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.142710 12122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.143999 12122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.145260 12122 hybrid_clock.cc:648] HybridClock initialized: now 1779112818145191 us; error 57 us; skew 500 ppm
14:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.145714 12122 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.148608 12122 webserver.cc:533] Webserver started at http://127.11.110.2:35777/ using document root <none> and password file <none>
14:00:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.149475 12122 fs_manager.cc:362] Metadata directory not provided
14:00:18.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.149631 12122 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:18.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.150053 12122 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.152699 12122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data/instance:
14:00:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "145cf203e0d94f66ba9c11ccc96cb8ea"
14:00:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:18 on dist-test-slave-c15h"
14:00:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.153609 12122 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal/instance:
14:00:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "145cf203e0d94f66ba9c11ccc96cb8ea"
14:00:18.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:18 on dist-test-slave-c15h"
14:00:18.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.159453 12122 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
14:00:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.163192 12136 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.164876 12122 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.165036 12122 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "145cf203e0d94f66ba9c11ccc96cb8ea"
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:18 on dist-test-slave-c15h"
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.165239 12122 fs_report.cc:389] FS layout report
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data/data
14:00:18.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:18.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.182348 12122 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:18.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.183350 12122 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:18.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.183610 12122 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:18.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.184749 12122 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:00:18.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.186583 12122 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:00:18.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.186684 12122 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:00:18.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.186764 12122 ts_tablet_manager.cc:616] Registered 0 tablets
14:00:18.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.186815 12122 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:00:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.224326 12122 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.2:38785
14:00:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.224524 12248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.2:38785 every 8 connection(s)
14:00:18.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.225888 12122 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/data/info.pb
14:00:18.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.230033 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 12122
14:00:18.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.230249 11704 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal/instance
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.237862 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:18.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/logs
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data/info.pb
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.3:0
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.110.3
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.3
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:18.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:00:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.245790 12249 heartbeater.cc:344] Connected to a master server at 127.11.110.60:41117
14:00:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.245888 12251 heartbeater.cc:344] Connected to a master server at 127.11.110.61:33299
14:00:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.246268 12251 heartbeater.cc:461] Registering TS with master...
14:00:18.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.246265 12249 heartbeater.cc:461] Registering TS with master...
14:00:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.247654 12249 heartbeater.cc:507] Master 127.11.110.60:41117 requested a full tablet report, sending...
14:00:18.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.247679 12251 heartbeater.cc:507] Master 127.11.110.61:33299 requested a full tablet report, sending...
14:00:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.249742 11817 ts_manager.cc:194] Registered new tserver with Master: 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785)
14:00:18.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.249833 11888 ts_manager.cc:194] Registered new tserver with Master: 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785)
14:00:18.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.257917 12250 heartbeater.cc:344] Connected to a master server at 127.11.110.62:41937
14:00:18.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.258119 12250 heartbeater.cc:461] Registering TS with master...
14:00:18.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.258701 12250 heartbeater.cc:507] Master 127.11.110.62:41937 requested a full tablet report, sending...
14:00:18.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.259999 11745 ts_manager.cc:194] Registered new tserver with Master: 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785)
14:00:18.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.260856 11745 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.110.2:46859
14:00:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.582389 12256 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.582721 12256 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.582792 12256 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:18.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.591580 12256 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:18.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.591764 12256 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.110.3
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.601976 12256 tablet_server_runner.cc:78] Tablet server non-default flags:
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.3:0
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data/info.pb
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.3
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.110.3
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/logs
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:18.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.603677 12256 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:18.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.605443 12256 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:18.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.615218 12261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:18.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.615250 12262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.616070 12264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.616887 12256 server_base.cc:1061] running on GCE node
14:00:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.617679 12256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:18.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.618798 12256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:18.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.620038 12256 hybrid_clock.cc:648] HybridClock initialized: now 1779112818620005 us; error 35 us; skew 500 ppm
14:00:18.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.620405 12256 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:18.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.622839 12256 webserver.cc:533] Webserver started at http://127.11.110.3:44725/ using document root <none> and password file <none>
14:00:18.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.623867 12256 fs_manager.cc:362] Metadata directory not provided
14:00:18.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.624001 12256 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:18.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.624390 12256 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:00:18.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.627147 12256 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data/instance:
14:00:18.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d23eafe91aff4fbe872aaed8f928be3c"
14:00:18.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:18 on dist-test-slave-c15h"
14:00:18.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.628015 12256 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal/instance:
14:00:18.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d23eafe91aff4fbe872aaed8f928be3c"
14:00:18.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:18 on dist-test-slave-c15h"
14:00:18.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.633813 12256 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
14:00:18.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.637324 12270 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.638803 12256 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.639041 12256 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d23eafe91aff4fbe872aaed8f928be3c"
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:18 on dist-test-slave-c15h"
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.639309 12256 fs_report.cc:389] FS layout report
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data/data
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:18.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:18.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:18.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.674624 12256 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:18.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.675686 12256 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:18.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.676050 12256 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:18.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.677186 12256 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:00:18.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.678977 12256 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:00:18.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.679091 12256 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
14:00:18.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.679210 12256 ts_tablet_manager.cc:616] Registered 0 tablets
14:00:18.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.679303 12256 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:00:18.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.715231 12256 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.3:40001
14:00:18.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.715353 12382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.3:40001 every 8 connection(s)
14:00:18.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.716639 12256 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/data/info.pb
14:00:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.721968 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 12256
14:00:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.722158 11704 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-2/wal/instance
14:00:18.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.742568 12385 heartbeater.cc:344] Connected to a master server at 127.11.110.61:33299
14:00:18.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.743111 12385 heartbeater.cc:461] Registering TS with master...
14:00:18.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.743243 12384 heartbeater.cc:344] Connected to a master server at 127.11.110.62:41937
14:00:18.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.743575 12384 heartbeater.cc:461] Registering TS with master...
14:00:18.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.743305 12383 heartbeater.cc:344] Connected to a master server at 127.11.110.60:41117
14:00:18.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.744314 12383 heartbeater.cc:461] Registering TS with master...
14:00:18.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.745409 12384 heartbeater.cc:507] Master 127.11.110.62:41937 requested a full tablet report, sending...
14:00:18.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.745440 12383 heartbeater.cc:507] Master 127.11.110.60:41117 requested a full tablet report, sending...
14:00:18.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.745465 12385 heartbeater.cc:507] Master 127.11.110.61:33299 requested a full tablet report, sending...
14:00:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.747330 11745 ts_manager.cc:194] Registered new tserver with Master: d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001)
14:00:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.747498 11888 ts_manager.cc:194] Registered new tserver with Master: d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001)
14:00:18.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.747730 11817 ts_manager.cc:194] Registered new tserver with Master: d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001)
14:00:18.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.748477 11745 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.110.3:38425
14:00:18.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.753357 11704 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:00:18.755 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:00:18.755 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:00:18.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.756910 12113 heartbeater.cc:499] Master 127.11.110.62:41937 was elected leader, sending a full tablet report...
14:00:18.758 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.110.62"
      port: 41937
    }
    bound_http_address {
      host: "127.11.110.62"
      port: 45925
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.110.61"
      port: 33299
    }
    bound_http_address {
      host: "127.11.110.61"
      port: 35795
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.110.60"
      port: 41117
    }
    bound_http_address {
      host: "127.11.110.60"
      port: 43711
    }
  }
}

14:00:18.759 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:00:18.761 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.110.1"
      port: 40033
    }
    bound_http_address {
      host: "127.11.110.1"
      port: 38193
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.110.2"
      port: 38785
    }
    bound_http_address {
      host: "127.11.110.2"
      port: 35777
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.110.3"
      port: 40001
    }
    bound_http_address {
      host: "127.11.110.3"
      port: 44725
    }
  }
}

14:00:18.761 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:00:18.763 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:00:18.766 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.110.61:33299(127.11.110.61:33299)] connecting to peer
14:00:18.768 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.110.62:41937(127.11.110.62:41937)] connecting to peer
14:00:18.768 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.110.61:33299(127.11.110.61:33299)] Successfully connected to peer
14:00:18.771 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.110.61
14:00:18.772 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.110.60:41117(127.11.110.60:41117)] connecting to peer
14:00:18.773 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.110.62:41937(127.11.110.62:41937)] Successfully connected to peer
14:00:18.775 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.110.60:41117(127.11.110.60:41117)] Successfully connected to peer
14:00:18.781 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.110.60
14:00:18.783 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.110.62
14:00:18.790 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x88cb4ad6, L:/127.0.0.1:37322 - R:/127.11.110.61:33299] using SASL/PLAIN
14:00:18.800 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x83a0d275, L:/127.0.0.1:47312 - R:/127.11.110.60:41117] using SASL/PLAIN
14:00:18.807 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x348cd786, L:/127.0.0.1:38654 - R:/127.11.110.62:41937] using SASL/PLAIN
14:00:18.811 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:00:18.811 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=46), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [29ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, deferred=null) after lookup
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.813854 11746 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38654:
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:00:18.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:00:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.815851 11746 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:00:18.848 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2312b1679bb94c70b4389b3472fdb923
14:00:18.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.869436 12318 tablet_service.cc:1511] Processing CreateTablet for tablet a14dfdd5331247548f5d1a3018a9982a (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=2312b1679bb94c70b4389b3472fdb923]), partition=RANGE (key) PARTITION UNBOUNDED
14:00:18.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.871443 12318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14dfdd5331247548f5d1a3018a9982a. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:18.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.872157 12184 tablet_service.cc:1511] Processing CreateTablet for tablet a14dfdd5331247548f5d1a3018a9982a (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=2312b1679bb94c70b4389b3472fdb923]), partition=RANGE (key) PARTITION UNBOUNDED
14:00:18.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.873342 12184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14dfdd5331247548f5d1a3018a9982a. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:18.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.877188 12047 tablet_service.cc:1511] Processing CreateTablet for tablet a14dfdd5331247548f5d1a3018a9982a (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=2312b1679bb94c70b4389b3472fdb923]), partition=RANGE (key) PARTITION UNBOUNDED
14:00:18.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.878690 12047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14dfdd5331247548f5d1a3018a9982a. 1 dirs total, 0 dirs full, 0 dirs failed
14:00:18.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.881500 12413 tablet_bootstrap.cc:492] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: Bootstrap starting.
14:00:18.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.884975 12413 tablet_bootstrap.cc:654] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: Neither blocks nor log segments found. Creating new log.
14:00:18.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.886286 12413 log.cc:826] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: Log is configured to *not* fsync() on all Append() calls
14:00:18.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.886356 12414 tablet_bootstrap.cc:492] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Bootstrap starting.
14:00:18.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.891088 12414 tablet_bootstrap.cc:654] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Neither blocks nor log segments found. Creating new log.
14:00:18.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.892614 12416 tablet_bootstrap.cc:492] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Bootstrap starting.
14:00:18.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.892596 12414 log.cc:826] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Log is configured to *not* fsync() on all Append() calls
14:00:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.894143 12413 tablet_bootstrap.cc:492] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: No bootstrap required, opened a new log
14:00:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.894436 12413 ts_tablet_manager.cc:1403] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
14:00:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.895391 12414 tablet_bootstrap.cc:492] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: No bootstrap required, opened a new log
14:00:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.895670 12414 ts_tablet_manager.cc:1403] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.001s
14:00:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.896250 12416 tablet_bootstrap.cc:654] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Neither blocks nor log segments found. Creating new log.
14:00:18.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.897303 12416 log.cc:826] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Log is configured to *not* fsync() on all Append() calls
14:00:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.899729 12416 tablet_bootstrap.cc:492] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: No bootstrap required, opened a new log
14:00:18.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.900564 12416 ts_tablet_manager.cc:1403] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Time spent bootstrapping tablet: real 0.008s	user 0.007s	sys 0.000s
14:00:18.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.901690 12413 raft_consensus.cc:359] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.902099 12413 raft_consensus.cc:385] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:18.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.902197 12413 raft_consensus.cc:740] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23eafe91aff4fbe872aaed8f928be3c, State: Initialized, Role: FOLLOWER
14:00:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.902624 12414 raft_consensus.cc:359] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.903010 12414 raft_consensus.cc:385] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.902905 12413 consensus_queue.cc:260] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.903106 12414 raft_consensus.cc:740] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 145cf203e0d94f66ba9c11ccc96cb8ea, State: Initialized, Role: FOLLOWER
14:00:18.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.903919 12414 consensus_queue.cc:260] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.904496 12384 heartbeater.cc:499] Master 127.11.110.62:41937 was elected leader, sending a full tablet report...
14:00:18.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.905144 12413 ts_tablet_manager.cc:1434] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
14:00:18.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.907922 12250 heartbeater.cc:499] Master 127.11.110.62:41937 was elected leader, sending a full tablet report...
14:00:18.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.907195 12414 ts_tablet_manager.cc:1434] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
14:00:18.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.913343 12416 raft_consensus.cc:359] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.914111 12416 raft_consensus.cc:385] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:00:18.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.914251 12416 raft_consensus.cc:740] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62192dc767a42f394dbbc99f972e058, State: Initialized, Role: FOLLOWER
14:00:18.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.915051 12416 consensus_queue.cc:260] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.918251 12419 raft_consensus.cc:493] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:00:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.918648 12416 ts_tablet_manager.cc:1434] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
14:00:18.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.918512 12419 raft_consensus.cc:515] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.920699 12419 leader_election.cc:290] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785), f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:18.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.929287 12067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "d23eafe91aff4fbe872aaed8f928be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62192dc767a42f394dbbc99f972e058" is_pre_election: true
14:00:18.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.929884 12067 raft_consensus.cc:2468] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23eafe91aff4fbe872aaed8f928be3c in term 0.
14:00:18.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.930523 12204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "d23eafe91aff4fbe872aaed8f928be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" is_pre_election: true
14:00:18.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.930680 12272 leader_election.cc:304] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d23eafe91aff4fbe872aaed8f928be3c, f62192dc767a42f394dbbc99f972e058; no voters: 
14:00:18.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.931124 12204 raft_consensus.cc:2468] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23eafe91aff4fbe872aaed8f928be3c in term 0.
14:00:18.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.931316 12419 raft_consensus.cc:2804] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Leader pre-election won for term 1
14:00:18.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.931449 12419 raft_consensus.cc:493] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:00:18.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.931581 12419 raft_consensus.cc:3060] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 0 FOLLOWER]: Advancing to term 1
14:00:18.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.933633 12419 raft_consensus.cc:515] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.934273 12419 leader_election.cc:290] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [CANDIDATE]: Term 1 election: Requested vote from peers 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785), f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:18.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.934743 12204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "d23eafe91aff4fbe872aaed8f928be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea"
14:00:18.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.934866 12067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "d23eafe91aff4fbe872aaed8f928be3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62192dc767a42f394dbbc99f972e058"
14:00:18.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.934906 12204 raft_consensus.cc:3060] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 0 FOLLOWER]: Advancing to term 1
14:00:18.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.935141 12067 raft_consensus.cc:3060] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 0 FOLLOWER]: Advancing to term 1
14:00:18.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.936954 12204 raft_consensus.cc:2468] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23eafe91aff4fbe872aaed8f928be3c in term 1.
14:00:18.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.937286 12067 raft_consensus.cc:2468] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23eafe91aff4fbe872aaed8f928be3c in term 1.
14:00:18.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.937350 12272 leader_election.cc:304] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 145cf203e0d94f66ba9c11ccc96cb8ea, d23eafe91aff4fbe872aaed8f928be3c; no voters: 
14:00:18.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.937686 12419 raft_consensus.cc:2804] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 1 FOLLOWER]: Leader election won for term 1
14:00:18.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.938247 12419 raft_consensus.cc:697] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [term 1 LEADER]: Becoming Leader. State: Replica: d23eafe91aff4fbe872aaed8f928be3c, State: Running, Role: LEADER
14:00:18.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.938907 12419 consensus_queue.cc:237] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:18.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:18.945384 11745 catalog_manager.cc:5696] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c reported cstate change: term changed from 0 to 1, leader changed from <none> to d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3). New cstate: current_term: 1 leader_uuid: "d23eafe91aff4fbe872aaed8f928be3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } health_report { overall_health: UNKNOWN } } }
14:00:18.971 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 2312b1679bb94c70b4389b3472fdb923
14:00:18.975 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a14dfdd5331247548f5d1a3018a9982a for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:00:18.976 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a14dfdd5331247548f5d1a3018a9982a@[145cf203e0d94f66ba9c11ccc96cb8ea(127.11.110.2:38785),d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)[L],f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)]}]
14:00:18.976 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.62:41937, [3ms] Sub RPC GetTableLocations: received response from server master-127.11.110.62:41937: OK, deferred=null) after lookup
14:00:18.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.976323 12115 tablet.cc:2404] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:18.977 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] connecting to peer
14:00:18.979 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] Successfully connected to peer
14:00:18.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.983775 12386 tablet.cc:2404] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:18.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:18.985245 12252 tablet.cc:2404] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:00:19.003 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x55b1f6ca, L:/127.0.0.1:42494 - R:/127.11.110.3:40001] using TOKEN/null
14:00:19.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.015333 12067 raft_consensus.cc:1275] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Refusing update from remote peer d23eafe91aff4fbe872aaed8f928be3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:19.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.015340 12204 raft_consensus.cc:1275] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Refusing update from remote peer d23eafe91aff4fbe872aaed8f928be3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:00:19.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.016588 12419 consensus_queue.cc:1048] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:19.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.017341 12422 consensus_queue.cc:1048] T a14dfdd5331247548f5d1a3018a9982a P d23eafe91aff4fbe872aaed8f928be3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:00:19.140 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a14dfdd5331247548f5d1a3018a9982a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:00:19.141 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.11.110.62:41937
14:00:19.141 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

14:00:19.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.141981 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11715
14:00:19.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.143501 11776 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:19.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.280030 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11715
14:00:19.309 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.110.62:41937(127.11.110.62:41937)] handling channelInactive
14:00:19.309 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.110.62:41937(127.11.110.62:41937)] cleaning up while in state READY due to: connection closed
14:00:19.310 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:00:19.310 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.11.110.62:41937
14:00:19.313 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 0
  }
}

14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.314881 11704 external_mini_cluster.cc:1366] Running /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task78Poou/build/asan/bin/kudu
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/logs
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/info.pb
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.62:41937
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.62
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=45925
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:19.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:19.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json with env {}
14:00:19.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.681313 12437 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:00:19.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.681674 12437 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:00:19.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.681766 12437 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:00:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.691005 12437 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:00:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.691123 12437 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:00:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.691180 12437 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:00:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.691221 12437 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:00:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.691275 12437 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:00:19.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.691309 12437 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46671/jwks.json
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.702114 12437 master_runner.cc:387] Master server non-default flags:
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.110.20:44727
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.110.62:41937,127.11.110.61:33299,127.11.110.60:41117
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:00:19.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.110.62:41937
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46671/jwks.json
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/info.pb
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.110.62
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=45925
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/logs
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 13:43:23 UTC on bdcb31816ec0
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11958
14:00:19.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
14:00:19.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.703995 12437 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:00:19.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.705842 12437 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:00:19.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.715893 12442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:19.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.715890 12443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:19.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:19.716799 12445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:00:19.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.718017 12437 server_base.cc:1061] running on GCE node
14:00:19.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.718866 12437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:00:19.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.720880 12437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:00:19.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.722191 12437 hybrid_clock.cc:648] HybridClock initialized: now 1779112819722121 us; error 58 us; skew 500 ppm
14:00:19.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.722661 12437 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:00:19.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.734241 12437 webserver.cc:533] Webserver started at http://127.11.110.62:45925/ using document root <none> and password file <none>
14:00:19.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.735291 12437 fs_manager.cc:362] Metadata directory not provided
14:00:19.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.735466 12437 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:00:19.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.744213 12437 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.007s	sys 0.001s
14:00:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.747727 12451 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:00:19.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.749166 12437 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.749402 12437 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data,/tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82adaae36e1248559e30afdb3cdb0bdd"
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:00:15 on dist-test-slave-c15h"
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.750228 12437 fs_report.cc:389] FS layout report
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/wal
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/data
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:00:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:00:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:00:19.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.766314 12437 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:00:19.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.767417 12437 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:00:19.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.767793 12437 kserver.cc:163] Server-wide thread pool size limit: 3276
14:00:19.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.788967 12437 rpc_server.cc:307] RPC server started. Bound to: 127.11.110.62:41937
14:00:19.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.789001 12502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.110.62:41937 every 8 connection(s)
14:00:19.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.790755 12437 server_base.cc:1193] Dumped server information to /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/master-0/data/info.pb
14:00:19.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.795535 11704 external_mini_cluster.cc:1428] Started /tmp/dist-test-task78Poou/build/asan/bin/kudu as pid 12437
14:00:19.796 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:00:19.796 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.11.110.3:40001
14:00:19.797 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

14:00:19.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.797422 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 12256
14:00:19.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.798583 12503 sys_catalog.cc:263] Verifying existing consensus state
14:00:19.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.802906 12503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Bootstrap starting.
14:00:19.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.810770 12378 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:19.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.822043 12503 log.cc:826] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Log is configured to *not* fsync() on all Append() calls
14:00:19.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.833923 12503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
14:00:19.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.834584 12503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: Bootstrap complete.
14:00:19.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.841555 12503 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:19.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.842325 12503 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82adaae36e1248559e30afdb3cdb0bdd, State: Initialized, Role: FOLLOWER
14:00:19.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.843181 12503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:19.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.844153 12509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:19.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.844651 12509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: FOLLOWER
14:00:19.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.845492 12503 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: configured and running, proceeding with master startup.
14:00:19.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.856235 12520 catalog_manager.cc:1294] Loaded cluster ID: aa59f109da3b494cba2deb5dd64c9a72
14:00:19.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.856765 12520 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: loading cluster ID for follower catalog manager: success
14:00:19.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.875435 12520 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: acquiring CA information for follower catalog manager: success
14:00:19.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.881572 12520 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:00:19.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.919202 12437 master_runner.cc:264] No leader master found from master 82adaae36e1248559e30afdb3cdb0bdd
14:00:19.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.919371 12437 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:19.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:19.960700 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 12256
14:00:19.983 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] handling channelInactive
14:00:19.983 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] cleaning up while in state READY due to: connection closed
14:00:19.984 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:00:19.985 [DEBUG - Time-limited test] (Connection.java:748) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] connecting to peer
14:00:19.987 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:19.988 [DEBUG - kudu-nio-4] (Connection.java:709) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] cleaning up while in state CONNECTING due to: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:19.988 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001) for tablet a14dfdd5331247548f5d1a3018a9982a: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.006 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.11.110.62:41937(127.11.110.62:41937)] connecting to peer
14:00:20.009 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.11.110.62:41937(127.11.110.62:41937)] Successfully connected to peer
14:00:20.037 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xb4ab33e1, L:/127.0.0.1:38676 - R:/127.11.110.62:41937] using TOKEN/null
14:00:20.041 [DEBUG - kudu-nio-5] (RemoteTablet.java:166) master-127.11.110.62:41937 was demoted as the leader for Kudu Master
14:00:20.053 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.067803 12468 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" instance_seqno: 1779112818215489) as {username='slave'} at 127.11.110.2:59075; Asking this server to re-register.
14:00:20.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.068917 12467 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f62192dc767a42f394dbbc99f972e058" instance_seqno: 1779112817711134) as {username='slave'} at 127.11.110.1:43545; Asking this server to re-register.
14:00:20.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.069959 12113 heartbeater.cc:461] Registering TS with master...
14:00:20.070 [WARN - kudu-nio-0] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.071576 12250 heartbeater.cc:461] Registering TS with master...
14:00:20.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.072183 12467 ts_manager.cc:194] Registered new tserver with Master: f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:20.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.073468 12467 ts_manager.cc:194] Registered new tserver with Master: 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785)
14:00:20.091 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.110 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.150 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.212 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.329 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.389 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117 is a leader; will retry
14:00:20.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.454604 12531 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82adaae36e1248559e30afdb3cdb0bdd)
14:00:20.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.454854 12531 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:20.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.455060 12532 raft_consensus.cc:493] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82adaae36e1248559e30afdb3cdb0bdd)
14:00:20.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.455216 12532 raft_consensus.cc:515] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:20.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.456305 12531 leader_election.cc:290] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82adaae36e1248559e30afdb3cdb0bdd (127.11.110.62:41937), 06451373b8084aeaa21024d122b2af2f (127.11.110.60:41117)
14:00:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.456955 11898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85fd3897dce24b7a82b1544b233e546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "06451373b8084aeaa21024d122b2af2f" is_pre_election: true
14:00:20.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.457181 11898 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fd3897dce24b7a82b1544b233e546b in term 1.
14:00:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.457990 11803 leader_election.cc:304] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06451373b8084aeaa21024d122b2af2f, 85fd3897dce24b7a82b1544b233e546b; no voters: 
14:00:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.458252 12532 leader_election.cc:290] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82adaae36e1248559e30afdb3cdb0bdd (127.11.110.62:41937), 85fd3897dce24b7a82b1544b233e546b (127.11.110.61:33299)
14:00:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.458599 11827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "06451373b8084aeaa21024d122b2af2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "85fd3897dce24b7a82b1544b233e546b" is_pre_election: true
14:00:20.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.458660 12531 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Leader pre-election won for term 2
14:00:20.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.459188 12531 raft_consensus.cc:493] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 82adaae36e1248559e30afdb3cdb0bdd)
14:00:20.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.459339 12531 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 1 FOLLOWER]: Advancing to term 2
14:00:20.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.462502 12531 raft_consensus.cc:515] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:20.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.463439 11827 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06451373b8084aeaa21024d122b2af2f in current term 2: Already voted for candidate 85fd3897dce24b7a82b1544b233e546b in this term.
14:00:20.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.463959 12531 leader_election.cc:290] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [CANDIDATE]: Term 2 election: Requested vote from peers 82adaae36e1248559e30afdb3cdb0bdd (127.11.110.62:41937), 06451373b8084aeaa21024d122b2af2f (127.11.110.60:41117)
14:00:20.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.464922 11898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85fd3897dce24b7a82b1544b233e546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "06451373b8084aeaa21024d122b2af2f"
14:00:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.464875 12477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85fd3897dce24b7a82b1544b233e546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "82adaae36e1248559e30afdb3cdb0bdd"
14:00:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.465142 11898 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 1 FOLLOWER]: Advancing to term 2
14:00:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.465082 12478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "85fd3897dce24b7a82b1544b233e546b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "82adaae36e1248559e30afdb3cdb0bdd" is_pre_election: true
14:00:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.465384 12477 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 1 FOLLOWER]: Advancing to term 2
14:00:20.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.465332 12476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "06451373b8084aeaa21024d122b2af2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "82adaae36e1248559e30afdb3cdb0bdd" is_pre_election: true
14:00:20.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.466845 11873 leader_election.cc:304] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06451373b8084aeaa21024d122b2af2f; no voters: 82adaae36e1248559e30afdb3cdb0bdd, 85fd3897dce24b7a82b1544b233e546b
14:00:20.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.467813 11898 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fd3897dce24b7a82b1544b233e546b in term 2.
14:00:20.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.468091 12532 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:00:20.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.468325 11803 leader_election.cc:304] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06451373b8084aeaa21024d122b2af2f, 85fd3897dce24b7a82b1544b233e546b; no voters: 
14:00:20.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.468714 12531 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 2 FOLLOWER]: Leader election won for term 2
14:00:20.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.469139 12531 raft_consensus.cc:697] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [term 2 LEADER]: Becoming Leader. State: Replica: 85fd3897dce24b7a82b1544b233e546b, State: Running, Role: LEADER
14:00:20.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.469655 12531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } }
14:00:20.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.470387 12477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fd3897dce24b7a82b1544b233e546b in term 2.
14:00:20.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.471714 12535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85fd3897dce24b7a82b1544b233e546b. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:20.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.472048 12535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: This master's current role is: LEADER
14:00:20.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.472713 12537 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
14:00:20.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.475183 12537 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=2312b1679bb94c70b4389b3472fdb923]
14:00:20.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.476789 12537 tablet_loader.cc:96] loaded metadata for tablet a14dfdd5331247548f5d1a3018a9982a (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=2312b1679bb94c70b4389b3472fdb923])
14:00:20.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.477042 12537 catalog_manager.cc:1519] Initializing Kudu cluster ID...
14:00:20.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.477814 12537 catalog_manager.cc:1294] Loaded cluster ID: aa59f109da3b494cba2deb5dd64c9a72
14:00:20.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.477892 12537 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
14:00:20.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.479003 12537 catalog_manager.cc:1539] Loading token signing keys...
14:00:20.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.479772 12537 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: Loaded TSK: 0
14:00:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.480643 12537 catalog_manager.cc:1549] Initializing in-progress tserver states...
14:00:20.732 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:00:20.733 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=10, TimeoutTracker(timeout=29979, elapsed=726), Traces: [0ms] sending RPC to server master-127.11.110.62:41937, [35ms] delaying RPC due to: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [35ms] received response from server master-127.11.110.62:41937: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [44ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [48ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [64ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [83ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [85ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [103ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [104ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [143ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [144ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [203ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [205ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [206ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [323ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [323ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [323ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [323ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [383ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [383ms] delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [720ms] refreshing cache from master, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [724ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [725ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, deferred=Deferred@491499767(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC -> (continuation of Deferred@1163262906 after retry RPC after error@740067590) -> (continuation of Deferred@1038654714 after retry RPC after error@2103726008) -> (continuation of Deferred@386331525 after retry RPC after error@1595546842) -> (continuation of Deferred@653022351 after retry RPC after error@2032850533) -> (continuation of Deferred@1502648350 after retry RPC after error@1457759034) -> (continuation of Deferred@309321029 after retry RPC after error@1037678739) -> (continuation of Deferred@1616152414 after retry RPC after error@728044061) -> (continuation of Deferred@1200383937 after retry RPC after error@929124995), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1163262906 after retry RPC after error@740067590) -> (continuation of Deferred@1038654714 after retry RPC after error@2103726008) -> (continuation of Deferred@386331525 after retry RPC after error@1595546842) -> (continuation of Deferred@653022351 after retry RPC after error@2032850533) -> (continuation of Deferred@1502648350 after retry RPC after error@1457759034) -> (continuation of Deferred@309321029 after retry RPC after error@1037678739) -> (continuation of Deferred@1616152414 after retry RPC after error@728044061) -> (continuation of Deferred@1200383937 after retry RPC after error@929124995))) after lookup
14:00:20.738 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a14dfdd5331247548f5d1a3018a9982a for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:00:20.738 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a14dfdd5331247548f5d1a3018a9982a@[145cf203e0d94f66ba9c11ccc96cb8ea(127.11.110.2:38785),d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)[L],f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)]}]
14:00:20.739 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a14dfdd5331247548f5d1a3018a9982a, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=753), Traces: [0ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [3ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [3ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.62:41937, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.11.110.62:41937: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [61ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [69ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [81ms] Sub RPC GetTableLocations: refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [85ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [101ms] Sub RPC GetTableLocations: refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [121ms] Sub RPC GetTableLocations: refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [161ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [165ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [221ms] Sub RPC GetTableLocations: refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [227ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [341ms] Sub RPC GetTableLocations: refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [344ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [401ms] Sub RPC GetTableLocations: refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [404ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [749ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [752ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, deferred=Deferred@1891454152(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@542b8f71 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@69632a3d -> wakeup thread Time-limited test)) after lookup
14:00:20.740 [DEBUG - kudu-nio-0] (Connection.java:748) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] connecting to peer
14:00:20.742 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.742 [DEBUG - kudu-nio-6] (Connection.java:709) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] cleaning up while in state CONNECTING due to: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.742 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001) for tablet a14dfdd5331247548f5d1a3018a9982a: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.749 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a14dfdd5331247548f5d1a3018a9982a for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:00:20.749 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a14dfdd5331247548f5d1a3018a9982a@[145cf203e0d94f66ba9c11ccc96cb8ea(127.11.110.2:38785),d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)[L],f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)]}]
14:00:20.750 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a14dfdd5331247548f5d1a3018a9982a, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=764), Traces: [0ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [3ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [3ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.62:41937, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.11.110.62:41937: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [61ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [69ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [81ms] Sub RPC GetTableLocations: refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [85ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [101ms] Sub RPC GetTableLocations: refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [121ms] Sub RPC GetTableLocations: refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [161ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [165ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [221ms] Sub RPC GetTableLocations: refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [227ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [341ms] Sub RPC GetTableLocations: refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [344ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [401ms] Sub RPC GetTableLocations: refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [404ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [749ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [752ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [755ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [757ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [757ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [761ms] refreshing cache from master, [761ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [763ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, deferred=Deferred@1891454152(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@542b8f71 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@69632a3d -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545))) after lookup
14:00:20.752 [DEBUG - kudu-nio-0] (Connection.java:748) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] connecting to peer
14:00:20.755 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.755 [DEBUG - kudu-nio-7] (Connection.java:709) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] cleaning up while in state CONNECTING due to: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.755 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001) for tablet a14dfdd5331247548f5d1a3018a9982a: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.790 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a14dfdd5331247548f5d1a3018a9982a for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:00:20.790 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a14dfdd5331247548f5d1a3018a9982a@[145cf203e0d94f66ba9c11ccc96cb8ea(127.11.110.2:38785),d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)[L],f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)]}]
14:00:20.791 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a14dfdd5331247548f5d1a3018a9982a, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=806), Traces: [0ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [3ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [3ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.62:41937, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.11.110.62:41937: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [61ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [69ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [81ms] Sub RPC GetTableLocations: refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [85ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [101ms] Sub RPC GetTableLocations: refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [121ms] Sub RPC GetTableLocations: refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [161ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [165ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [221ms] Sub RPC GetTableLocations: refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [227ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [341ms] Sub RPC GetTableLocations: refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [344ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [401ms] Sub RPC GetTableLocations: refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [404ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [749ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [752ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [755ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [757ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [757ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [761ms] refreshing cache from master, [761ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [763ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [767ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [770ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [770ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [801ms] refreshing cache from master, [802ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [805ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, deferred=Deferred@1891454152(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@542b8f71 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545) -> (continuation of Deferred@1365984295 after retry RPC@6194563), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@69632a3d -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545) -> (continuation of Deferred@1365984295 after retry RPC@6194563))) after lookup
14:00:20.792 [DEBUG - kudu-nio-0] (Connection.java:748) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] connecting to peer
14:00:20.794 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.794 [DEBUG - kudu-nio-0] (Connection.java:709) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] cleaning up while in state CONNECTING due to: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.794 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001) for tablet a14dfdd5331247548f5d1a3018a9982a: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.829 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a14dfdd5331247548f5d1a3018a9982a for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:00:20.830 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a14dfdd5331247548f5d1a3018a9982a@[145cf203e0d94f66ba9c11ccc96cb8ea(127.11.110.2:38785),d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)[L],f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)]}]
14:00:20.830 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a14dfdd5331247548f5d1a3018a9982a, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=845), Traces: [0ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [3ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [3ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.62:41937, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.11.110.62:41937: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [61ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [69ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [81ms] Sub RPC GetTableLocations: refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [85ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [101ms] Sub RPC GetTableLocations: refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [121ms] Sub RPC GetTableLocations: refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [161ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [165ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [221ms] Sub RPC GetTableLocations: refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [227ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [341ms] Sub RPC GetTableLocations: refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [344ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [401ms] Sub RPC GetTableLocations: refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [404ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [749ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [752ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [755ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [757ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [757ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [761ms] refreshing cache from master, [761ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [763ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [767ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [770ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [770ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [801ms] refreshing cache from master, [802ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [805ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [807ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [809ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [809ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [841ms] refreshing cache from master, [841ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [844ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, deferred=Deferred@1891454152(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@542b8f71 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545) -> (continuation of Deferred@1365984295 after retry RPC@6194563) -> (continuation of Deferred@2115222256 after retry RPC@137540223), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@69632a3d -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545) -> (continuation of Deferred@1365984295 after retry RPC@6194563) -> (continuation of Deferred@2115222256 after retry RPC@137540223))) after lookup
14:00:20.832 [DEBUG - kudu-nio-0] (Connection.java:748) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] connecting to peer
14:00:20.833 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.833 [DEBUG - kudu-nio-1] (Connection.java:709) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] cleaning up while in state CONNECTING due to: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.833 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001) for tablet a14dfdd5331247548f5d1a3018a9982a: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001
14:00:20.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.918056 12477 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [term 2 FOLLOWER]: Refusing update from remote peer 85fd3897dce24b7a82b1544b233e546b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
14:00:20.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.919081 12535 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
14:00:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.923532 12540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85fd3897dce24b7a82b1544b233e546b. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.923918 12540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: FOLLOWER
14:00:20.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.925328 12531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:20.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.925626 12531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: This master's current role is: LEADER
14:00:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.926447 11898 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [term 2 FOLLOWER]: Refusing update from remote peer 85fd3897dce24b7a82b1544b233e546b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
14:00:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.926455 12540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.926661 12540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82adaae36e1248559e30afdb3cdb0bdd [sys.catalog]: This master's current role is: FOLLOWER
14:00:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.927124 12535 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
14:00:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.935539 12546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.935896 12532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85fd3897dce24b7a82b1544b233e546b. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.936365 12532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: This master's current role is: FOLLOWER
14:00:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:20.936365 12546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06451373b8084aeaa21024d122b2af2f [sys.catalog]: This master's current role is: FOLLOWER
14:00:21.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.018177 12547 raft_consensus.cc:493] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d23eafe91aff4fbe872aaed8f928be3c)
14:00:21.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.018364 12547 raft_consensus.cc:515] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:21.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.020068 12547 leader_election.cc:290] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001), f62192dc767a42f394dbbc99f972e058 (127.11.110.1:40033)
14:00:21.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.021308 12139 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111)
14:00:21.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.033833 12067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "f62192dc767a42f394dbbc99f972e058" is_pre_election: true
14:00:21.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.034060 12139 leader_election.cc:336] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001): Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111)
14:00:21.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.034570 12138 leader_election.cc:304] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 145cf203e0d94f66ba9c11ccc96cb8ea; no voters: d23eafe91aff4fbe872aaed8f928be3c, f62192dc767a42f394dbbc99f972e058
14:00:21.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.035154 12547 raft_consensus.cc:2749] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:00:21.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.070273 12552 raft_consensus.cc:493] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d23eafe91aff4fbe872aaed8f928be3c)
14:00:21.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.070590 12552 raft_consensus.cc:515] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.072392 12552 leader_election.cc:290] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001), 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785)
14:00:21.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.076807 12002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111)
14:00:21.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.078876 12002 leader_election.cc:336] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001): Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111)
14:00:21.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.081061 12204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "f62192dc767a42f394dbbc99f972e058" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" is_pre_election: true
14:00:21.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.081344 12204 raft_consensus.cc:2468] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62192dc767a42f394dbbc99f972e058 in term 1.
14:00:21.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.081943 12001 leader_election.cc:304] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 145cf203e0d94f66ba9c11ccc96cb8ea, f62192dc767a42f394dbbc99f972e058; no voters: d23eafe91aff4fbe872aaed8f928be3c
14:00:21.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.082435 12552 raft_consensus.cc:2804] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:00:21.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.082590 12552 raft_consensus.cc:493] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d23eafe91aff4fbe872aaed8f928be3c)
14:00:21.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.082747 12552 raft_consensus.cc:3060] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 1 FOLLOWER]: Advancing to term 2
14:00:21.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.084841 12552 raft_consensus.cc:515] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:21.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.085589 12552 leader_election.cc:290] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [CANDIDATE]: Term 2 election: Requested vote from peers d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001), 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785)
14:00:21.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.086339 12204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14dfdd5331247548f5d1a3018a9982a" candidate_uuid: "f62192dc767a42f394dbbc99f972e058" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea"
14:00:21.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.086570 12204 raft_consensus.cc:3060] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 1 FOLLOWER]: Advancing to term 2
14:00:21.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.087149 12002 leader_election.cc:336] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001): Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111)
14:00:21.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.090209 12204 raft_consensus.cc:2468] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62192dc767a42f394dbbc99f972e058 in term 2.
14:00:21.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.090873 12001 leader_election.cc:304] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 145cf203e0d94f66ba9c11ccc96cb8ea, f62192dc767a42f394dbbc99f972e058; no voters: d23eafe91aff4fbe872aaed8f928be3c
14:00:21.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.091310 12552 raft_consensus.cc:2804] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 2 FOLLOWER]: Leader election won for term 2
14:00:21.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.091970 12552 raft_consensus.cc:697] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 2 LEADER]: Becoming Leader. State: Replica: f62192dc767a42f394dbbc99f972e058, State: Running, Role: LEADER
14:00:21.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.092504 12114 heartbeater.cc:499] Master 127.11.110.61:33299 was elected leader, sending a full tablet report...
14:00:21.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.092708 12552 consensus_queue.cc:237] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } }
14:00:21.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.097383 11817 catalog_manager.cc:5696] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 reported cstate change: term changed from 1 to 2, leader changed from d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3) to f62192dc767a42f394dbbc99f972e058 (127.11.110.1). New cstate: current_term: 2 leader_uuid: "f62192dc767a42f394dbbc99f972e058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23eafe91aff4fbe872aaed8f928be3c" member_type: VOTER last_known_addr { host: "127.11.110.3" port: 40001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f62192dc767a42f394dbbc99f972e058" member_type: VOTER last_known_addr { host: "127.11.110.1" port: 40033 } health_report { overall_health: HEALTHY } } }
14:00:21.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.104537 12535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "85fd3897dce24b7a82b1544b233e546b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } }
14:00:21.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.104882 12535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b [sys.catalog]: This master's current role is: LEADER
14:00:21.229 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a14dfdd5331247548f5d1a3018a9982a for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:00:21.230 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a14dfdd5331247548f5d1a3018a9982a@[145cf203e0d94f66ba9c11ccc96cb8ea(127.11.110.2:38785),d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001),f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)[L]]}]
14:00:21.231 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a14dfdd5331247548f5d1a3018a9982a, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1245), Traces: [0ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [3ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [3ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.62:41937, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.11.110.62:41937: Illegal state: Not the leader. Local UUID: 82adaae36e1248559e30afdb3cdb0bdd, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82adaae36e1248559e30afdb3cdb0bdd" member_type: VOTER last_known_addr { host: "127.11.110.62" port: 41937 } } peers { permanent_uuid: "85fd3897dce24b7a82b1544b233e546b" member_type: VOTER last_known_addr { host: "127.11.110.61" port: 33299 } } peers { permanent_uuid: "06451373b8084aeaa21024d122b2af2f" member_type: VOTER last_known_addr { host: "127.11.110.60" port: 41117 } } } (error 0), [61ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [65ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [69ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [81ms] Sub RPC GetTableLocations: refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [84ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [85ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [101ms] Sub RPC GetTableLocations: refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [104ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [121ms] Sub RPC GetTableLocations: refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [124ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [125ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [161ms] Sub RPC GetTableLocations: refreshing cache from master, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [165ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [221ms] Sub RPC GetTableLocations: refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [222ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [226ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [227ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [341ms] Sub RPC GetTableLocations: refreshing cache from master, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [344ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [344ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [401ms] Sub RPC GetTableLocations: refreshing cache from master, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [404ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [404ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.11.110.61:33299,127.11.110.62:41937,127.11.110.60:41117) has no leader., [741ms] Sub RPC GetTableLocations: refreshing cache from master, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.61:33299, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.62:41937, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.110.60:41117, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.60:41117: OK, [745ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.62:41937: OK, [746ms] Sub RPC ConnectToMaster: received response from server master-127.11.110.61:33299: OK, [749ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [752ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [755ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [757ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [757ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [761ms] refreshing cache from master, [761ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [763ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [767ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [770ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [770ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [801ms] refreshing cache from master, [802ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [805ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [807ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [809ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [809ms] delaying RPC due to: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [841ms] refreshing cache from master, [841ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.110.61:33299, [844ms] Sub RPC GetTableLocations: received response from server master-127.11.110.61:33299: OK, [846ms] sending RPC to server d23eafe91aff4fbe872aaed8f928be3c, [848ms] received response from server d23eafe91aff4fbe872aaed8f928be3c: Network error: Failed to connect to peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001): Connection refused: /127.11.110.3:40001, [848ms] too many traces: truncated at 100 traces, deferred=Deferred@1891454152(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$234/0x00007f70f43357f8@542b8f71 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545) -> (continuation of Deferred@1365984295 after retry RPC@6194563) -> (continuation of Deferred@2115222256 after retry RPC@137540223) -> (continuation of Deferred@676102808 after retry RPC@904952996), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@69632a3d -> wakeup thread Time-limited test -> (continuation of Deferred@491499767 after retry RPC@573608545) -> (continuation of Deferred@1365984295 after retry RPC@6194563) -> (continuation of Deferred@2115222256 after retry RPC@137540223) -> (continuation of Deferred@676102808 after retry RPC@904952996))) after lookup
14:00:21.232 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)] connecting to peer
14:00:21.233 [DEBUG - kudu-nio-2] (Connection.java:757) [peer f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)] Successfully connected to peer
14:00:21.253 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x93b93e79, L:/127.0.0.1:48926 - R:/127.11.110.1:40033] using TOKEN/null
14:00:21.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.259465 12204 raft_consensus.cc:1275] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 2 FOLLOWER]: Refusing update from remote peer f62192dc767a42f394dbbc99f972e058: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
14:00:21.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.260281 12557 consensus_queue.cc:1048] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "145cf203e0d94f66ba9c11ccc96cb8ea" member_type: VOTER last_known_addr { host: "127.11.110.2" port: 38785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
14:00:21.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.260653 12002 consensus_peers.cc:597] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 -> Peer d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001): Couldn't send request to peer d23eafe91aff4fbe872aaed8f928be3c. Status: Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:00:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.262212 12251 heartbeater.cc:499] Master 127.11.110.61:33299 was elected leader, sending a full tablet report...
14:00:21.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.267762 12564 mvcc.cc:204] Tried to move back new op lower bound from 7287246115870621696 to 7287246115199500288. Current Snapshot: MvccSnapshot[applied={T|T < 7287246115870621696}]
14:00:21.365 [DEBUG - kudu-nio-2] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a14dfdd5331247548f5d1a3018a9982a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:00:21.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.368031 11817 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37322:
14:00:21.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
14:00:21.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.368343 11817 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37322:
14:00:21.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
14:00:21.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.376225 11817 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 85fd3897dce24b7a82b1544b233e546b: Sending DeleteTablet for 3 replicas of tablet a14dfdd5331247548f5d1a3018a9982a
14:00:21.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.392691 12184 tablet_service.cc:1558] Processing DeleteTablet for tablet a14dfdd5331247548f5d1a3018a9982a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 14:00:21 UTC) from {username='slave'} at 127.0.0.1:41234
14:00:21.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.393729 12574 tablet_replica.cc:333] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: stopping tablet replica
14:00:21.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.394405 12574 raft_consensus.cc:2243] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 2 FOLLOWER]: Raft consensus shutting down.
14:00:21.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.396648 12574 raft_consensus.cc:2272] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea [term 2 FOLLOWER]: Raft consensus is shut down!
14:00:21.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.398423 11803 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111) [suppressed 4 similar messages]
14:00:21.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.398876 12574 ts_tablet_manager.cc:1916] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Deleting tablet data with delete state TABLET_DATA_DELETED
14:00:21.401 [DEBUG - main] (Connection.java:575) [peer master-127.11.110.62:41937(127.11.110.62:41937)] disconnecting while in state READY
14:00:21.402 [DEBUG - main] (Connection.java:575) [peer master-127.11.110.60:41117(127.11.110.60:41117)] disconnecting while in state READY
14:00:21.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.401460 12047 tablet_service.cc:1558] Processing DeleteTablet for tablet a14dfdd5331247548f5d1a3018a9982a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 14:00:21 UTC) from {username='slave'} at 127.0.0.1:48932
14:00:21.404 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.11.110.62:41937(127.11.110.62:41937)] handling channelInactive
14:00:21.402 [DEBUG - main] (Connection.java:575) [peer d23eafe91aff4fbe872aaed8f928be3c(127.11.110.3:40001)] disconnecting while in state TERMINATED
14:00:21.405 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.110.60:41117(127.11.110.60:41117)] handling channelInactive
14:00:21.405 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.110.60:41117(127.11.110.60:41117)] cleaning up while in state READY due to: connection closed
14:00:21.405 [DEBUG - main] (Connection.java:575) [peer master-127.11.110.61:33299(127.11.110.61:33299)] disconnecting while in state READY
14:00:21.405 [DEBUG - main] (Connection.java:575) [peer f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)] disconnecting while in state READY
14:00:21.406 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:00:21.406 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.110.61:33299(127.11.110.61:33299)] handling channelInactive
14:00:21.406 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.110.61:33299(127.11.110.61:33299)] cleaning up while in state READY due to: connection closed
14:00:21.407 [DEBUG - kudu-nio-2] (Connection.java:239) [peer f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)] handling channelInactive
14:00:21.407 [DEBUG - kudu-nio-2] (Connection.java:709) [peer f62192dc767a42f394dbbc99f972e058(127.11.110.1:40033)] cleaning up while in state READY due to: connection closed
14:00:21.407 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.11.110.62:41937(127.11.110.62:41937)] cleaning up while in state READY due to: connection closed
14:00:21.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.408563 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11985
14:00:21.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.416313 12574 ts_tablet_manager.cc:1929] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
14:00:21.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.416502 12574 log.cc:1199] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Deleting WAL directory at /tmp/dist-test-task78Poou/test-tmp/mini-kudu-cluster4857016243668595904/ts-1/wal/wals/a14dfdd5331247548f5d1a3018a9982a
14:00:21.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.417121 12574 ts_tablet_manager.cc:1950] T a14dfdd5331247548f5d1a3018a9982a P 145cf203e0d94f66ba9c11ccc96cb8ea: Deleting consensus metadata
14:00:21.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.419204 11802 catalog_manager.cc:5027] TS 145cf203e0d94f66ba9c11ccc96cb8ea (127.11.110.2:38785): tablet a14dfdd5331247548f5d1a3018a9982a (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=2312b1679bb94c70b4389b3472fdb923]) successfully deleted
14:00:21.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.419879 12576 tablet_replica.cc:333] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: stopping tablet replica
14:00:21.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.420504 12576 raft_consensus.cc:2243] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 2 LEADER]: Raft consensus shutting down.
14:00:21.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.421617 12576 raft_consensus.cc:2272] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058 [term 2 FOLLOWER]: Raft consensus is shut down!
14:00:21.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.424978 12576 ts_tablet_manager.cc:1916] T a14dfdd5331247548f5d1a3018a9982a P f62192dc767a42f394dbbc99f972e058: Deleting tablet data with delete state TABLET_DATA_DELETED
14:00:21.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:00:21.425887 11803 catalog_manager.cc:4754] TS d23eafe91aff4fbe872aaed8f928be3c (127.11.110.3:40001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a14dfdd5331247548f5d1a3018a9982a: Network error: Client connection negotiation failed: client connection to 127.11.110.3:40001: connect: Connection refused (error 111)
14:00:21.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.429940 12107 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:21.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.540882 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11985
14:00:21.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.561534 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 12122
14:00:21.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.569161 12244 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:21.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.668462 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 12122
14:00:21.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.686239 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 12437
14:00:21.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.692848 12498 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:21.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.802083 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 12437
14:00:21.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.822594 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11785
14:00:21.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.823887 11847 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:21.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.941231 11785 master_runner.cc:187] Error getting master registration for 127.11.110.62:41937: Network error: Client connection negotiation failed: client connection to 127.11.110.62:41937: connect: Connection refused (error 111), 
14:00:21.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.941473 11785 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:00:21.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.941751 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11785
14:00:21.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.963330 11704 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task78Poou/build/asan/bin/kudu pid 11854
14:00:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:21.964582 11918 generic_service.cc:196] Checking for leaks (request via RPC)
14:00:22.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:00:22.078291 11704 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task78Poou/build/asan/bin/kudu with pid 11854
14:00:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:00:22Z chronyd exiting

Time: 16.75

OK (2 tests)

