JUnit version 4.13.2
.21:00:15.782 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783544415774
21:00:15.834 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
21:00:15.867 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
21:00:15.874 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskOoRw2s/test-tmp
21:00:15.897 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
21:00:15.900 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskOoRw2s/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
21:00:16.078 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

21:00:16.301 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
21:00:16.302 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

21:00:16.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.305533 15760 mini_oidc.cc:150] Starting JWKS server
21:00:16.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.307861 15760 webserver.cc:534] Webserver started at http://127.0.0.1:37183/ using document root <none> and password file <none>
21:00:16.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.308133 15760 mini_oidc.cc:186] Starting OIDC Discovery server
21:00:16.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.308775 15760 webserver.cc:534] Webserver started at http://127.0.0.1:43441/ using document root <none> and password file <none>
21:00:16.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T21:00:16Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
21:00:16.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T21:00:16Z Disabled control of system clock
21:00:16.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.337764 15760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:16.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:16.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal
21:00:16.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data
21:00:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/logs
21:00:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data/info.pb
21:00:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:16.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.62:45877
21:00:16.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.62
21:00:16.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:16.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:16.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:16.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:16.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:16.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:16.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:16.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:16.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37183/jwks.json with env {}
21:00:16.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.659719 15771 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:16.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.660090 15771 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:16.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.660218 15771 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:16.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.668753 15771 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:16.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.668889 15771 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:16.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.668973 15771 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:16.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.669031 15771 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:16.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.669112 15771 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:16.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.669162 15771 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37183/jwks.json
21:00:16.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.679526 15771 master_runner.cc:387] Master server non-default flags:
21:00:16.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:16.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:16.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:16.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:16.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data
21:00:16.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal
21:00:16.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:16.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.62:45877
21:00:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:16.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:16.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:16.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37183/jwks.json
21:00:16.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:16.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:16.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data/info.pb
21:00:16.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.62
21:00:16.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:16.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:16.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/logs
21:00:16.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:16.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:16.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:16.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:16.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:16.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:16.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:16.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.681725 15771 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:16.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.684258 15771 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:16.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.694028 15777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:16.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.694059 15776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:16.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.694998 15779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:16.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.695200 15771 server_base.cc:1061] running on GCE node
21:00:16.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.696184 15771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:16.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.697748 15771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:16.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.698997 15771 hybrid_clock.cc:648] HybridClock initialized: now 1783544416698930 us; error 60 us; skew 500 ppm
21:00:16.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.699462 15771 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:16.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.701877 15771 webserver.cc:534] Webserver started at http://127.15.100.62:35799/ using document root <none> and password file <none>
21:00:16.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.702761 15771 fs_manager.cc:362] Metadata directory not provided
21:00:16.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.702907 15771 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:16.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.703394 15771 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:16.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.705899 15771 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data/instance:
21:00:16.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7bec699425da4353a2f5817a2c9e5d0c"
21:00:16.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:16 on dist-test-slave-xb7w"
21:00:16.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.706862 15771 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal/instance:
21:00:16.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7bec699425da4353a2f5817a2c9e5d0c"
21:00:16.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:16 on dist-test-slave-xb7w"
21:00:16.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.712813 15771 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
21:00:16.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.716719 15785 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.718227 15771 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
21:00:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.718375 15771 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal
21:00:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7bec699425da4353a2f5817a2c9e5d0c"
21:00:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:16 on dist-test-slave-xb7w"
21:00:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.718539 15771 fs_report.cc:389] FS layout report
21:00:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal
21:00:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal
21:00:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data/data
21:00:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:16.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:16.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:16.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:16.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:16.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:16.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:16.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:16.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:16.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:16.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:16.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.739995 15771 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:16.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.740871 15771 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:16.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.741094 15771 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.761852 15771 rpc_server.cc:307] RPC server started. Bound to: 127.15.100.62:45877
21:00:16.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.761854 15836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.100.62:45877 every 8 connection(s)
21:00:16.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.763424 15771 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/data/info.pb
21:00:16.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.765748 15760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 15771
21:00:16.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.765992 15760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-0/wal/instance
21:00:16.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.767971 15837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:16.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.768262 15760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:16.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:16.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal
21:00:16.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data
21:00:16.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:16.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:16.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/logs
21:00:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data/info.pb
21:00:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:16.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.61:42263
21:00:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.61
21:00:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:16.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:16.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:16.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:16.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:16.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:16.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:16.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37183/jwks.json with env {}
21:00:16.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.775446 15837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } has no permanent_uuid. Determining permanent_uuid...
21:00:16.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.791638 15837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } has no permanent_uuid. Determining permanent_uuid...
21:00:16.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.792670 15788 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.100.61:42263: connect: Connection refused (error 111)
21:00:16.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.794292 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.61:42263: Network error: Client connection negotiation failed: client connection to 127.15.100.61:42263: connect: Connection refused (error 111)
21:00:16.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.843673 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } attempt: 1
21:00:16.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.845990 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.61:42263: Network error: Client connection negotiation failed: client connection to 127.15.100.61:42263: connect: Connection refused (error 111)
21:00:16.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:16.914280 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } attempt: 2
21:00:16.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:16.916543 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.61:42263: Network error: Client connection negotiation failed: client connection to 127.15.100.61:42263: connect: Connection refused (error 111)
21:00:17.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.007813 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } attempt: 3
21:00:17.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.010398 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.61:42263: Network error: Client connection negotiation failed: client connection to 127.15.100.61:42263: connect: Connection refused (error 111)
21:00:17.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.101419 15839 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:17.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.101796 15839 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:17.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.101928 15839 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:17.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.110576 15839 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:17.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.110728 15839 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:17.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.110814 15839 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:17.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.110872 15839 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:17.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.110945 15839 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:17.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.110994 15839 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37183/jwks.json
21:00:17.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.121840 15839 master_runner.cc:387] Master server non-default flags:
21:00:17.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:17.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:17.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:17.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.61:42263
21:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37183/jwks.json
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data/info.pb
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.61
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/logs
21:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:17.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:17.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:17.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:17.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:17.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:17.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:17.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:17.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:17.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.124143 15839 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:17.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.126713 15839 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:17.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.139884 15847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:17.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.139901 15848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.140908 15850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:17.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.141582 15839 server_base.cc:1061] running on GCE node
21:00:17.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.142582 15839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:17.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.144181 15839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:17.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.145399 15839 hybrid_clock.cc:648] HybridClock initialized: now 1783544417145337 us; error 56 us; skew 500 ppm
21:00:17.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.145779 15839 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.148138 15839 webserver.cc:534] Webserver started at http://127.15.100.61:32887/ using document root <none> and password file <none>
21:00:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.148813 15839 fs_manager.cc:362] Metadata directory not provided
21:00:17.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.148900 15839 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:17.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.149401 15839 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.152038 15839 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data/instance:
21:00:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "592d538b0f1a4705af37bf5a009afe52"
21:00:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:17 on dist-test-slave-xb7w"
21:00:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.152889 15839 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal/instance:
21:00:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "592d538b0f1a4705af37bf5a009afe52"
21:00:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:17 on dist-test-slave-xb7w"
21:00:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.153669 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } attempt: 4
21:00:17.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.155850 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.61:42263: Network error: Client connection negotiation failed: client connection to 127.15.100.61:42263: connect: Connection refused (error 111)
21:00:17.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.158747 15839 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
21:00:17.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.162262 15856 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.163780 15839 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
21:00:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.163923 15839 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal
21:00:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "592d538b0f1a4705af37bf5a009afe52"
21:00:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:17 on dist-test-slave-xb7w"
21:00:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.164104 15839 fs_report.cc:389] FS layout report
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data/data
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:17.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:17.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:17.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.186414 15839 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:17.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.187592 15839 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:17.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.187840 15839 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:17.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.209606 15839 rpc_server.cc:307] RPC server started. Bound to: 127.15.100.61:42263
21:00:17.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.209653 15907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.100.61:42263 every 8 connection(s)
21:00:17.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.211117 15839 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/data/info.pb
21:00:17.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.215713 15908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:17.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.216985 15760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 15839
21:00:17.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.217170 15760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-1/wal/instance
21:00:17.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.218469 15760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:17.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:17.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:17.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/logs
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data/info.pb
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:17.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.60:34043
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.60
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:17.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:17.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:17.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37183/jwks.json with env {}
21:00:17.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.224768 15908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.239668 15908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.250147 15908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.251587 15857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.253407 15908 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.302754 15908 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 1
21:00:17.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.304966 15908 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.373230 15908 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 2
21:00:17.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.375499 15908 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.455118 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } attempt: 5
21:00:17.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.466780 15908 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 3
21:00:17.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.466956 15837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.469257 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.469606 15908 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.520495 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 1
21:00:17.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.522590 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.569170 15910 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:17.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.569578 15910 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:17.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.569697 15910 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.578236 15910 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.578471 15910 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.578573 15910 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.578634 15910 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.578709 15910 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.578756 15910 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:37183/jwks.json
21:00:17.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.589252 15910 master_runner.cc:387] Master server non-default flags:
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:17.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.60:34043
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:17.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:37183/jwks.json
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data/info.pb
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.60
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:17.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/logs
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:17.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:17.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.590828 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 2
21:00:17.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.591621 15910 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:17.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.594395 15910 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:17.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.596601 15837 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.603772 15918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:17.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.603739 15919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:17.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.605268 15910 server_base.cc:1061] running on GCE node
21:00:17.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.605489 15921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:17.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.606400 15910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:17.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.608035 15910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:17.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.609282 15910 hybrid_clock.cc:648] HybridClock initialized: now 1783544417609232 us; error 35 us; skew 500 ppm
21:00:17.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.609716 15910 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:17.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.612099 15910 webserver.cc:534] Webserver started at http://127.15.100.60:42837/ using document root <none> and password file <none>
21:00:17.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.612829 15908 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 4
21:00:17.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.612908 15910 fs_manager.cc:362] Metadata directory not provided
21:00:17.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.613039 15910 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:17.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.613485 15910 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:17.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.614692 15908 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:17.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.616231 15910 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data/instance:
21:00:17.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21c8bea0f8fd4eb89435e29afc5a2916"
21:00:17.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:17 on dist-test-slave-xb7w"
21:00:17.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.617024 15910 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal/instance:
21:00:17.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21c8bea0f8fd4eb89435e29afc5a2916"
21:00:17.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:17 on dist-test-slave-xb7w"
21:00:17.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.622275 15910 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
21:00:17.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.625780 15927 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.627314 15910 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
21:00:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.627458 15910 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal
21:00:17.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21c8bea0f8fd4eb89435e29afc5a2916"
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:17 on dist-test-slave-xb7w"
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.627624 15910 fs_report.cc:389] FS layout report
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data/data
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:17.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:17.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:17.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.649583 15910 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.650408 15910 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.650650 15910 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:17.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.671455 15910 rpc_server.cc:307] RPC server started. Bound to: 127.15.100.60:34043
21:00:17.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.671499 15978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.100.60:34043 every 8 connection(s)
21:00:17.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.672899 15910 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/data/info.pb
21:00:17.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.677213 15979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.681061 15760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 15910
21:00:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.681280 15760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/master-2/wal/instance
21:00:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.683030 15979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.697681 15979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.702929 15837 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 3
21:00:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.705766 15979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } has no permanent_uuid. Determining permanent_uuid...
21:00:17.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.720710 15979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: Bootstrap starting.
21:00:17.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.721076 15837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: Bootstrap starting.
21:00:17.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.725416 15837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: Neither blocks nor log segments found. Creating new log.
21:00:17.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.725402 15979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: Neither blocks nor log segments found. Creating new log.
21:00:17.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.726859 15979 log.cc:826] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: Log is configured to *not* fsync() on all Append() calls
21:00:17.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.727276 15837 log.cc:826] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: Log is configured to *not* fsync() on all Append() calls
21:00:17.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.729823 15979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: No bootstrap required, opened a new log
21:00:17.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.730494 15837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: No bootstrap required, opened a new log
21:00:17.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.736056 15979 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.736331 15979 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:17.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.736413 15979 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c8bea0f8fd4eb89435e29afc5a2916, State: Initialized, Role: FOLLOWER
21:00:17.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.737030 15979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.736974 15837 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.737352 15837 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:17.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.737490 15837 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bec699425da4353a2f5817a2c9e5d0c, State: Initialized, Role: FOLLOWER
21:00:17.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.737982 15990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:17.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.738166 15837 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.738718 15990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: This master's current role is: FOLLOWER
21:00:17.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.739428 15979 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: configured and running, proceeding with master startup.
21:00:17.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.740181 15991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:17.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.740756 15991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: This master's current role is: FOLLOWER
21:00:17.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.741319 15837 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: configured and running, proceeding with master startup.
21:00:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.743819 15791 tablet.cc:2406] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:17.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.751454 16009 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
21:00:17.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.751995 16009 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
21:00:17.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.754916 15771 master_runner.cc:187] Error getting master registration for 127.15.100.61:42263: OK, instance_id { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" instance_seqno: 1783544417203775 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
21:00:17.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.768548 15771 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:17.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.756644 15910 master_runner.cc:187] Error getting master registration for 127.15.100.61:42263: OK, instance_id { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" instance_seqno: 1783544417203775 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
21:00:17.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.777511 15910 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:17.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.782099 16013 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
21:00:17.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.782765 16013 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
21:00:17.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:17.902805 15933 tablet.cc:2406] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:17.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.913944 15908 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } attempt: 5
21:00:17.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.927331 15908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: Bootstrap starting.
21:00:17.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.927380 15990 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
21:00:17.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.927628 15990 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.929388 15990 leader_election.cc:290] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bec699425da4353a2f5817a2c9e5d0c (127.15.100.62:45877), 592d538b0f1a4705af37bf5a009afe52 (127.15.100.61:42263)
21:00:17.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.931202 15812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bec699425da4353a2f5817a2c9e5d0c" is_pre_election: true
21:00:17.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.931706 15812 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c8bea0f8fd4eb89435e29afc5a2916 in term 0.
21:00:17.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.932320 15929 leader_election.cc:304] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c8bea0f8fd4eb89435e29afc5a2916, 7bec699425da4353a2f5817a2c9e5d0c; no voters: 
21:00:17.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.933219 15990 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Leader pre-election won for term 1
21:00:17.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.933369 15990 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
21:00:17.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.933468 15990 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 0 FOLLOWER]: Advancing to term 1
21:00:17.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.934176 15908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: Neither blocks nor log segments found. Creating new log.
21:00:17.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.935947 15908 log.cc:826] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: Log is configured to *not* fsync() on all Append() calls
21:00:17.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.937507 15990 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.938737 15990 leader_election.cc:290] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [CANDIDATE]: Term 1 election: Requested vote from peers 7bec699425da4353a2f5817a2c9e5d0c (127.15.100.62:45877), 592d538b0f1a4705af37bf5a009afe52 (127.15.100.61:42263)
21:00:17.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.939764 15812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bec699425da4353a2f5817a2c9e5d0c"
21:00:17.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.939993 15812 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 0 FOLLOWER]: Advancing to term 1
21:00:17.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.943956 15812 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c8bea0f8fd4eb89435e29afc5a2916 in term 1.
21:00:17.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.944587 15929 leader_election.cc:304] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c8bea0f8fd4eb89435e29afc5a2916, 7bec699425da4353a2f5817a2c9e5d0c; no voters: 
21:00:17.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.945364 15990 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 1 FOLLOWER]: Leader election won for term 1
21:00:17.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.946712 15990 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [term 1 LEADER]: Becoming Leader. State: Replica: 21c8bea0f8fd4eb89435e29afc5a2916, State: Running, Role: LEADER
21:00:17.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.947669 15990 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.962947 16017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21c8bea0f8fd4eb89435e29afc5a2916. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:17.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.963358 16017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: This master's current role is: LEADER
21:00:17.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.968480 15908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: No bootstrap required, opened a new log
21:00:17.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.976310 15908 raft_consensus.cc:359] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.976663 15908 raft_consensus.cc:385] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:17.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.976774 15908 raft_consensus.cc:740] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 592d538b0f1a4705af37bf5a009afe52, State: Initialized, Role: FOLLOWER
21:00:17.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.978511 16019 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
21:00:17.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.979899 15908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:17.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.980929 16019 catalog_manager.cc:1519] Initializing Kudu cluster ID...
21:00:17.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.999130 15908 sys_catalog.cc:565] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: configured and running, proceeding with master startup.
21:00:18.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.999243 15883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "592d538b0f1a4705af37bf5a009afe52" is_pre_election: true
21:00:18.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.999207 15882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "592d538b0f1a4705af37bf5a009afe52"
21:00:18.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.000712 15882 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 0 FOLLOWER]: Advancing to term 1
21:00:18.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.004236 15882 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c8bea0f8fd4eb89435e29afc5a2916 in term 1.
21:00:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:17.998889 16020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.008512 15882 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Refusing update from remote peer 21c8bea0f8fd4eb89435e29afc5a2916: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.013310 16017 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [LEADER]: Connected to new peer: Peer: permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:18.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.021078 16020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: This master's current role is: FOLLOWER
21:00:18.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.023386 15812 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 1 FOLLOWER]: Refusing update from remote peer 21c8bea0f8fd4eb89435e29afc5a2916: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:18.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.024508 16017 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:18.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.054633 15991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21c8bea0f8fd4eb89435e29afc5a2916. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.054917 15991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: This master's current role is: FOLLOWER
21:00:18.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.060194 15991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.060428 15991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: This master's current role is: FOLLOWER
21:00:18.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.060307 16020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21c8bea0f8fd4eb89435e29afc5a2916. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.060542 16020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: This master's current role is: FOLLOWER
21:00:18.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.063576 16021 mvcc.cc:204] Tried to move back new op lower bound from 7305397936117690368 to 7305397935921979392. Current Snapshot: MvccSnapshot[applied={T|T < 7305397936117690368}]
21:00:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.068392 16020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.068957 16020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: This master's current role is: FOLLOWER
21:00:18.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.070007 16029 mvcc.cc:204] Tried to move back new op lower bound from 7305397936117690368 to 7305397935921979392. Current Snapshot: MvccSnapshot[applied={T|T < 7305397936117690368 or (T in {7305397936117690368})}]
21:00:18.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.074270 16027 mvcc.cc:204] Tried to move back new op lower bound from 7305397936117690368 to 7305397935921979392. Current Snapshot: MvccSnapshot[applied={T|T < 7305397936117690368}]
21:00:18.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.075639 16017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.075821 16019 catalog_manager.cc:1382] Generated new cluster ID: 43c8dccd5912472f86a451ffa4a1dd89
21:00:18.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.075888 16017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: This master's current role is: LEADER
21:00:18.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.075922 16019 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
21:00:18.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.076762 16017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:18.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.076972 16017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916 [sys.catalog]: This master's current role is: LEADER
21:00:18.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.099920 16019 catalog_manager.cc:1405] Generated new certificate authority record
21:00:18.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.100008 16040 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
21:00:18.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.102398 16019 catalog_manager.cc:1539] Loading token signing keys...
21:00:18.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.122354 16019 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 21c8bea0f8fd4eb89435e29afc5a2916: Generated new TSK 0
21:00:18.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.124150 16019 catalog_manager.cc:1549] Initializing in-progress tserver states...
21:00:18.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.142030 15760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:18.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:18.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal
21:00:18.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/logs
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data/info.pb
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:18.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.1:0
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.100.1
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.1
21:00:18.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
21:00:18.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.549445 16042 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:18.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.549748 16042 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:18.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.549834 16042 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.558055 16042 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.558219 16042 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.100.1
21:00:18.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.568428 16042 tablet_server_runner.cc:78] Tablet server non-default flags:
21:00:18.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.1:0
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data/info.pb
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.1
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:18.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.100.1
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/logs
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:18.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.570421 16042 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:18.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.572329 16042 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.582051 16047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:18.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.583204 16048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:18.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:18.585165 16050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:18.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.585762 16042 server_base.cc:1061] running on GCE node
21:00:18.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.586352 16042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:18.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.587378 16042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:18.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.588627 16042 hybrid_clock.cc:648] HybridClock initialized: now 1783544418588573 us; error 47 us; skew 500 ppm
21:00:18.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.589026 16042 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:18.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.591421 16042 webserver.cc:534] Webserver started at http://127.15.100.1:42783/ using document root <none> and password file <none>
21:00:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.592245 16042 fs_manager.cc:362] Metadata directory not provided
21:00:18.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.592422 16042 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:18.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.592867 16042 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.595513 16042 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data/instance:
21:00:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20b12687f62442b980845cfdd35b31ee"
21:00:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:18 on dist-test-slave-xb7w"
21:00:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.596553 16042 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal/instance:
21:00:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20b12687f62442b980845cfdd35b31ee"
21:00:18.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:18 on dist-test-slave-xb7w"
21:00:18.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.602566 16042 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
21:00:18.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.606194 16056 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:18.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.607721 16042 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.607859 16042 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "20b12687f62442b980845cfdd35b31ee"
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:18 on dist-test-slave-xb7w"
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.608022 16042 fs_report.cc:389] FS layout report
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal
21:00:18.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data/data
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:18.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:18.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.630211 16042 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:18.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.631234 16042 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:18.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.631548 16042 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:18.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.632650 16042 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
21:00:18.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.634311 16042 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
21:00:18.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.634406 16042 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
21:00:18.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.634508 16042 ts_tablet_manager.cc:616] Registered 0 tablets
21:00:18.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.634599 16042 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
21:00:18.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.667979 16042 rpc_server.cc:307] RPC server started. Bound to: 127.15.100.1:38377
21:00:18.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.668068 16169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.100.1:38377 every 8 connection(s)
21:00:18.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.669399 16042 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/data/info.pb
21:00:18.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.677397 15760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16042
21:00:18.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.677582 15760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal/instance
21:00:18.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.684461 15760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:18.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:18.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/logs
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data/info.pb
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:18.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.2:0
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.100.2
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.2
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:18.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:18.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
21:00:18.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.724406 16170 heartbeater.cc:344] Connected to a master server at 127.15.100.60:34043
21:00:18.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.724861 16170 heartbeater.cc:461] Registering TS with master...
21:00:18.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.726006 16170 heartbeater.cc:507] Master 127.15.100.60:34043 requested a full tablet report, sending...
21:00:18.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.728386 16172 heartbeater.cc:344] Connected to a master server at 127.15.100.61:42263
21:00:18.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.728541 16172 heartbeater.cc:461] Registering TS with master...
21:00:18.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.728571 15944 ts_manager.cc:194] Registered new tserver with Master: 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:18.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.729054 16172 heartbeater.cc:507] Master 127.15.100.61:42263 requested a full tablet report, sending...
21:00:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.730824 15873 ts_manager.cc:194] Registered new tserver with Master: 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.730865 15944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.100.1:59589
21:00:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.731439 16171 heartbeater.cc:344] Connected to a master server at 127.15.100.62:45877
21:00:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.731583 16171 heartbeater.cc:461] Registering TS with master...
21:00:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.732172 16171 heartbeater.cc:507] Master 127.15.100.62:45877 requested a full tablet report, sending...
21:00:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.734494 15801 ts_manager.cc:194] Registered new tserver with Master: 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:18.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.785884 16013 catalog_manager.cc:1294] Loaded cluster ID: 43c8dccd5912472f86a451ffa4a1dd89
21:00:18.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.786008 16013 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: loading cluster ID for follower catalog manager: success
21:00:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.789561 16013 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: acquiring CA information for follower catalog manager: success
21:00:18.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:18.791962 16013 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
21:00:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.040378 16180 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.041188 16180 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.041304 16180 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:19.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.049587 16180 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:19.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.049741 16180 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.100.2
21:00:19.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.059531 16180 tablet_server_runner.cc:78] Tablet server non-default flags:
21:00:19.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.2:0
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data/info.pb
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.2
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.100.2
21:00:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/logs
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:19.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.061122 16180 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:19.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.062799 16180 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.071969 16186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.072156 16185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.072211 16188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.073149 16180 server_base.cc:1061] running on GCE node
21:00:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.073706 16180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:19.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.074577 16180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:19.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.075809 16180 hybrid_clock.cc:648] HybridClock initialized: now 1783544419075748 us; error 47 us; skew 500 ppm
21:00:19.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.076176 16180 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:19.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.078549 16180 webserver.cc:534] Webserver started at http://127.15.100.2:45841/ using document root <none> and password file <none>
21:00:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.079427 16180 fs_manager.cc:362] Metadata directory not provided
21:00:19.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.079566 16180 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:19.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.079985 16180 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:19.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.082338 16180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data/instance:
21:00:19.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "31b21adc95e345918aee87a13455750c"
21:00:19.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:19 on dist-test-slave-xb7w"
21:00:19.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.083249 16180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal/instance:
21:00:19.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "31b21adc95e345918aee87a13455750c"
21:00:19.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:19 on dist-test-slave-xb7w"
21:00:19.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.088343 16180 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
21:00:19.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.092036 16194 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:19.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.093473 16180 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.093681 16180 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "31b21adc95e345918aee87a13455750c"
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:19 on dist-test-slave-xb7w"
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.093981 16180 fs_report.cc:389] FS layout report
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data/data
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:19.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.105131 16040 catalog_manager.cc:1294] Loaded cluster ID: 43c8dccd5912472f86a451ffa4a1dd89
21:00:19.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.105312 16040 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: loading cluster ID for follower catalog manager: success
21:00:19.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.109231 16040 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: acquiring CA information for follower catalog manager: success
21:00:19.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.111783 16040 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
21:00:19.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.112972 16180 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:19.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.113922 16180 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:19.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.114293 16180 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:19.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.115525 16180 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
21:00:19.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.117452 16180 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
21:00:19.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.117594 16180 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
21:00:19.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.117702 16180 ts_tablet_manager.cc:616] Registered 0 tablets
21:00:19.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.117787 16180 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
21:00:19.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.166381 16180 rpc_server.cc:307] RPC server started. Bound to: 127.15.100.2:43645
21:00:19.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.166404 16307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.100.2:43645 every 8 connection(s)
21:00:19.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.168059 16180 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/data/info.pb
21:00:19.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.171641 15760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16180
21:00:19.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.171916 15760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal/instance
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.180876 15760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/logs
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data/info.pb
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
21:00:19.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:19.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.3:0
21:00:19.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.100.3
21:00:19.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.3
21:00:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
21:00:19.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.195367 16309 heartbeater.cc:344] Connected to a master server at 127.15.100.62:45877
21:00:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.195789 16309 heartbeater.cc:461] Registering TS with master...
21:00:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.196862 16309 heartbeater.cc:507] Master 127.15.100.62:45877 requested a full tablet report, sending...
21:00:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.197620 16310 heartbeater.cc:344] Connected to a master server at 127.15.100.61:42263
21:00:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.197764 16310 heartbeater.cc:461] Registering TS with master...
21:00:19.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.198258 16310 heartbeater.cc:507] Master 127.15.100.61:42263 requested a full tablet report, sending...
21:00:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.198681 15801 ts_manager.cc:194] Registered new tserver with Master: 31b21adc95e345918aee87a13455750c (127.15.100.2:43645)
21:00:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.199378 15873 ts_manager.cc:194] Registered new tserver with Master: 31b21adc95e345918aee87a13455750c (127.15.100.2:43645)
21:00:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.199913 16308 heartbeater.cc:344] Connected to a master server at 127.15.100.60:34043
21:00:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.200037 16308 heartbeater.cc:461] Registering TS with master...
21:00:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.200557 16308 heartbeater.cc:507] Master 127.15.100.60:34043 requested a full tablet report, sending...
21:00:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.201876 15944 ts_manager.cc:194] Registered new tserver with Master: 31b21adc95e345918aee87a13455750c (127.15.100.2:43645)
21:00:19.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.202994 15944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.100.2:37257
21:00:19.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.533318 16315 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:19.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.533674 16315 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:19.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.533790 16315 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:19.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.542747 16315 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:19.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.542968 16315 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.100.3
21:00:19.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.553259 16315 tablet_server_runner.cc:78] Tablet server non-default flags:
21:00:19.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:19.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.100.20:44529
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.100.3:0
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data/info.pb
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.100.3
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.100.62:45877,127.15.100.61:42263,127.15.100.60:34043
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:19.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.100.3
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/logs
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.555596 16315 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:19.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.557598 16315 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:19.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.567762 16320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:19.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.567831 16321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:19.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:19.568850 16323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:19.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.569581 16315 server_base.cc:1061] running on GCE node
21:00:19.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.570271 16315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:19.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.571359 16315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:19.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.572595 16315 hybrid_clock.cc:648] HybridClock initialized: now 1783544419572536 us; error 50 us; skew 500 ppm
21:00:19.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.572971 16315 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:19.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.575502 16315 webserver.cc:534] Webserver started at http://127.15.100.3:35393/ using document root <none> and password file <none>
21:00:19.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.576323 16315 fs_manager.cc:362] Metadata directory not provided
21:00:19.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.576462 16315 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:19.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.576856 16315 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:19.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.579394 16315 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data/instance:
21:00:19.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b50e1b262194523994958c991e39de4"
21:00:19.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:19 on dist-test-slave-xb7w"
21:00:19.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.580343 16315 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal/instance:
21:00:19.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b50e1b262194523994958c991e39de4"
21:00:19.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:19 on dist-test-slave-xb7w"
21:00:19.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.586215 16315 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
21:00:19.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.589977 16329 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:19.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.591741 16315 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.591921 16315 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0b50e1b262194523994958c991e39de4"
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:19 on dist-test-slave-xb7w"
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.592154 16315 fs_report.cc:389] FS layout report
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data/data
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:19.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:19.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:19.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.616390 16315 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:19.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.617301 16315 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:19.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.617558 16315 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:19.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.618594 16315 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
21:00:19.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.620358 16315 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
21:00:19.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.620455 16315 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
21:00:19.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.620533 16315 ts_tablet_manager.cc:616] Registered 0 tablets
21:00:19.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.620584 16315 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
21:00:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.657835 16315 rpc_server.cc:307] RPC server started. Bound to: 127.15.100.3:34249
21:00:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.657883 16441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.100.3:34249 every 8 connection(s)
21:00:19.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.659307 16315 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/data/info.pb
21:00:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.661845 15760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16315
21:00:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.662009 15760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-2/wal/instance
21:00:19.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.692760 16442 heartbeater.cc:344] Connected to a master server at 127.15.100.60:34043
21:00:19.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.693176 16442 heartbeater.cc:461] Registering TS with master...
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.694281 16442 heartbeater.cc:507] Master 127.15.100.60:34043 requested a full tablet report, sending...
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.694383 16444 heartbeater.cc:344] Connected to a master server at 127.15.100.61:42263
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.694548 16444 heartbeater.cc:461] Registering TS with master...
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.694751 16443 heartbeater.cc:344] Connected to a master server at 127.15.100.62:45877
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.694900 16443 heartbeater.cc:461] Registering TS with master...
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.695192 16444 heartbeater.cc:507] Master 127.15.100.61:42263 requested a full tablet report, sending...
21:00:19.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.695469 16443 heartbeater.cc:507] Master 127.15.100.62:45877 requested a full tablet report, sending...
21:00:19.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.696094 15944 ts_manager.cc:194] Registered new tserver with Master: 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249)
21:00:19.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.696367 15873 ts_manager.cc:194] Registered new tserver with Master: 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249)
21:00:19.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.696478 15801 ts_manager.cc:194] Registered new tserver with Master: 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249)
21:00:19.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.697134 15944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.100.3:53913
21:00:19.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.706902 15760 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
21:00:19.709 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
21:00:19.710 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

21:00:19.719 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.100.62"
      port: 45877
    }
    bound_http_address {
      host: "127.15.100.62"
      port: 35799
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.100.61"
      port: 42263
    }
    bound_http_address {
      host: "127.15.100.61"
      port: 32887
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.100.60"
      port: 34043
    }
    bound_http_address {
      host: "127.15.100.60"
      port: 42837
    }
  }
}

21:00:19.722 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

21:00:19.725 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.100.1"
      port: 38377
    }
    bound_http_address {
      host: "127.15.100.1"
      port: 42783
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.100.2"
      port: 43645
    }
    bound_http_address {
      host: "127.15.100.2"
      port: 45841
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.100.3"
      port: 34249
    }
    bound_http_address {
      host: "127.15.100.3"
      port: 35393
    }
  }
}

21:00:19.725 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
21:00:19.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:19.733693 16170 heartbeater.cc:499] Master 127.15.100.60:34043 was elected leader, sending a full tablet report...
21:00:19.930 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
21:00:19.993 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
21:00:20.157 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.15.100.62:45877(127.15.100.62:45877)] connecting to peer
21:00:20.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.206010 16308 heartbeater.cc:499] Master 127.15.100.60:34043 was elected leader, sending a full tablet report...
21:00:20.210 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:20.212 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.15.100.61:42263(127.15.100.61:42263)] connecting to peer
21:00:20.236 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.100.62:45877(127.15.100.62:45877)] Successfully connected to peer
21:00:20.238 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.100.61:42263(127.15.100.61:42263)] Successfully connected to peer
21:00:20.242 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.100.60:34043(127.15.100.60:34043)] Successfully connected to peer
21:00:20.334 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.100.61
21:00:20.335 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.100.60
21:00:20.335 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.15.100.62
21:00:20.552 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5fbdd1bb, L:/127.0.0.1:36242 - R:/127.15.100.62:45877] using SASL/PLAIN
21:00:20.552 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x262332cf, L:/127.0.0.1:50876 - R:/127.15.100.61:42263] using SASL/PLAIN
21:00:20.554 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9af439dd, L:/127.0.0.1:59600 - R:/127.15.100.60:34043] using SASL/PLAIN
21:00:20.589 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
21:00:20.590 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=477), Traces: [0ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [450ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [450ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [451ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: OK, deferred=null) after lookup
21:00:20.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.639493 15944 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59600:
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:20.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:20.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:20.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
21:00:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:20.641363 15944 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
21:00:20.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.699285 16442 heartbeater.cc:499] Master 127.15.100.60:34043 was elected leader, sending a full tablet report...
21:00:20.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.715600 16377 tablet_service.cc:1511] Processing CreateTablet for tablet 4adaa6ec4e5645bab565b20c2c941637 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b]), partition=RANGE (key) PARTITION UNBOUNDED
21:00:20.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.717697 16377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adaa6ec4e5645bab565b20c2c941637. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:20.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.717643 16105 tablet_service.cc:1511] Processing CreateTablet for tablet 4adaa6ec4e5645bab565b20c2c941637 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b]), partition=RANGE (key) PARTITION UNBOUNDED
21:00:20.718 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table f634ff7b05ec466bae8467fe70f53f6b
21:00:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.719678 16105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adaa6ec4e5645bab565b20c2c941637. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:20.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.725342 16243 tablet_service.cc:1511] Processing CreateTablet for tablet 4adaa6ec4e5645bab565b20c2c941637 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b]), partition=RANGE (key) PARTITION UNBOUNDED
21:00:20.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.726678 16243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adaa6ec4e5645bab565b20c2c941637. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:20.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.730631 16476 tablet_bootstrap.cc:492] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Bootstrap starting.
21:00:20.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.732388 16477 tablet_bootstrap.cc:492] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: Bootstrap starting.
21:00:20.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.734647 16476 tablet_bootstrap.cc:654] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Neither blocks nor log segments found. Creating new log.
21:00:20.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.736205 16476 log.cc:826] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Log is configured to *not* fsync() on all Append() calls
21:00:20.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.739969 16477 tablet_bootstrap.cc:654] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: Neither blocks nor log segments found. Creating new log.
21:00:20.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.741876 16477 log.cc:826] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: Log is configured to *not* fsync() on all Append() calls
21:00:20.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.746129 16479 tablet_bootstrap.cc:492] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Bootstrap starting.
21:00:20.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.752985 16477 tablet_bootstrap.cc:492] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: No bootstrap required, opened a new log
21:00:20.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.753602 16477 ts_tablet_manager.cc:1403] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.005s
21:00:20.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.763254 16477 raft_consensus.cc:359] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.764111 16477 raft_consensus.cc:385] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:20.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.764391 16477 raft_consensus.cc:740] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b50e1b262194523994958c991e39de4, State: Initialized, Role: FOLLOWER
21:00:20.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.764585 16479 tablet_bootstrap.cc:654] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Neither blocks nor log segments found. Creating new log.
21:00:20.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.765367 16477 consensus_queue.cc:260] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.766649 16479 log.cc:826] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Log is configured to *not* fsync() on all Append() calls
21:00:20.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.773682 16477 ts_tablet_manager.cc:1434] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.004s
21:00:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.781486 16476 tablet_bootstrap.cc:492] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: No bootstrap required, opened a new log
21:00:20.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.782133 16476 ts_tablet_manager.cc:1403] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.017s
21:00:20.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.790629 16479 tablet_bootstrap.cc:492] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: No bootstrap required, opened a new log
21:00:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.791306 16479 ts_tablet_manager.cc:1403] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.011s
21:00:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.791501 16476 raft_consensus.cc:359] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.792156 16476 raft_consensus.cc:385] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.792434 16476 raft_consensus.cc:740] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20b12687f62442b980845cfdd35b31ee, State: Initialized, Role: FOLLOWER
21:00:20.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.793354 16476 consensus_queue.cc:260] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.799197 16476 ts_tablet_manager.cc:1434] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
21:00:20.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.799427 16479 raft_consensus.cc:359] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.800073 16479 raft_consensus.cc:385] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:20.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.800455 16479 raft_consensus.cc:740] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31b21adc95e345918aee87a13455750c, State: Initialized, Role: FOLLOWER
21:00:20.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.801393 16479 consensus_queue.cc:260] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.804481 16479 ts_tablet_manager.cc:1434] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.005s
21:00:20.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.860589 16481 raft_consensus.cc:493] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
21:00:20.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.860843 16481 raft_consensus.cc:515] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.862609 16481 leader_election.cc:290] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31b21adc95e345918aee87a13455750c (127.15.100.2:43645), 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:20.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.872231 16125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "0b50e1b262194523994958c991e39de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20b12687f62442b980845cfdd35b31ee" is_pre_election: true
21:00:20.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.872231 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "0b50e1b262194523994958c991e39de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b21adc95e345918aee87a13455750c" is_pre_election: true
21:00:20.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.872826 16125 raft_consensus.cc:2468] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b50e1b262194523994958c991e39de4 in term 0.
21:00:20.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.872826 16263 raft_consensus.cc:2468] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b50e1b262194523994958c991e39de4 in term 0.
21:00:20.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.873528 16333 leader_election.cc:304] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b50e1b262194523994958c991e39de4, 20b12687f62442b980845cfdd35b31ee; no voters: 
21:00:20.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.873996 16481 raft_consensus.cc:2804] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Leader pre-election won for term 1
21:00:20.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.874152 16481 raft_consensus.cc:493] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
21:00:20.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.874276 16481 raft_consensus.cc:3060] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 0 FOLLOWER]: Advancing to term 1
21:00:20.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.877206 16481 raft_consensus.cc:515] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.877902 16481 leader_election.cc:290] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [CANDIDATE]: Term 1 election: Requested vote from peers 31b21adc95e345918aee87a13455750c (127.15.100.2:43645), 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.878382 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "0b50e1b262194523994958c991e39de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31b21adc95e345918aee87a13455750c"
21:00:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.878476 16125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "0b50e1b262194523994958c991e39de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20b12687f62442b980845cfdd35b31ee"
21:00:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.878592 16263 raft_consensus.cc:3060] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 0 FOLLOWER]: Advancing to term 1
21:00:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.878674 16125 raft_consensus.cc:3060] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 0 FOLLOWER]: Advancing to term 1
21:00:20.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.880934 16263 raft_consensus.cc:2468] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b50e1b262194523994958c991e39de4 in term 1.
21:00:20.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.881434 16331 leader_election.cc:304] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b50e1b262194523994958c991e39de4, 31b21adc95e345918aee87a13455750c; no voters: 
21:00:20.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.881898 16125 raft_consensus.cc:2468] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b50e1b262194523994958c991e39de4 in term 1.
21:00:20.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.881983 16481 raft_consensus.cc:2804] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 1 FOLLOWER]: Leader election won for term 1
21:00:20.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.882527 16481 raft_consensus.cc:697] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [term 1 LEADER]: Becoming Leader. State: Replica: 0b50e1b262194523994958c991e39de4, State: Running, Role: LEADER
21:00:20.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.883246 16481 consensus_queue.cc:237] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:20.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:20.888325 15944 catalog_manager.cc:5696] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b50e1b262194523994958c991e39de4 (127.15.100.3). New cstate: current_term: 1 leader_uuid: "0b50e1b262194523994958c991e39de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } health_report { overall_health: UNKNOWN } } }
21:00:20.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:20.913452 16445 tablet.cc:2406] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:20.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:20.929183 16311 tablet.cc:2406] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:20.940 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table f634ff7b05ec466bae8467fe70f53f6b
21:00:20.957 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4adaa6ec4e5645bab565b20c2c941637 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
21:00:20.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:20.959653 16179 tablet.cc:2406] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:20.964 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=4adaa6ec4e5645bab565b20c2c941637@[0b50e1b262194523994958c991e39de4(127.15.100.3:34249)[L],20b12687f62442b980845cfdd35b31ee(127.15.100.1:38377),31b21adc95e345918aee87a13455750c(127.15.100.2:43645)]}]
21:00:20.965 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=17), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.100.60:34043, [8ms] Sub RPC GetTableLocations: received response from server master-127.15.100.60:34043: OK, deferred=null) after lookup
21:00:20.977 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] connecting to peer
21:00:20.980 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] Successfully connected to peer
21:00:21.054 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8fdc4bf8, L:/127.0.0.1:33198 - R:/127.15.100.3:34249] using TOKEN/null
21:00:21.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.065089 16125 raft_consensus.cc:1275] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 1 FOLLOWER]: Refusing update from remote peer 0b50e1b262194523994958c991e39de4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:21.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.065317 16263 raft_consensus.cc:1275] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Refusing update from remote peer 0b50e1b262194523994958c991e39de4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:21.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.066447 16487 consensus_queue.cc:1048] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:21.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.066689 16481 consensus_queue.cc:1048] T 4adaa6ec4e5645bab565b20c2c941637 P 0b50e1b262194523994958c991e39de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:21.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.104511 16490 mvcc.cc:204] Tried to move back new op lower bound from 7305397948671455232 to 7305397947941548032. Current Snapshot: MvccSnapshot[applied={T|T < 7305397948671455232}]
21:00:21.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.107637 16492 mvcc.cc:204] Tried to move back new op lower bound from 7305397948671455232 to 7305397947941548032. Current Snapshot: MvccSnapshot[applied={T|T < 7305397948671455232}]
21:00:21.268 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=4adaa6ec4e5645bab565b20c2c941637, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
21:00:21.270 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.15.100.60:34043
21:00:21.271 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

21:00:21.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.272516 15760 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 15910
21:00:21.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.274230 15974 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:21.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.444012 15760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 15910
21:00:21.465 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
21:00:21.466 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.15.100.3:34249
21:00:21.467 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

21:00:21.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.467818 15760 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16315
21:00:21.468 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.100.60:34043(127.15.100.60:34043)] handling channelInactive
21:00:21.469 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state READY due to: connection closed
21:00:21.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.478013 16437 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:21.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:21.587761 15760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16315
21:00:21.606 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] handling channelInactive
21:00:21.607 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] cleaning up while in state READY due to: connection closed
21:00:21.607 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
21:00:21.608 [DEBUG - Time-limited test] (Connection.java:748) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] connecting to peer
21:00:21.610 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249): Connection refused: /127.15.100.3:34249
21:00:21.610 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249): Connection refused: /127.15.100.3:34249
21:00:21.610 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 0b50e1b262194523994958c991e39de4(127.15.100.3:34249) for tablet 4adaa6ec4e5645bab565b20c2c941637: Failed to connect to peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249): Connection refused: /127.15.100.3:34249
21:00:21.614 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.616 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.616 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.616 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.15.100.60:34043(127.15.100.60:34043) for tablet Kudu Master: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.634 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.637 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.637 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.638 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.641 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.655 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.657 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.657 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.658 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.660 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.674 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.675 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.676 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.676 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.678 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.695 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.696 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.696 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.696 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.698 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.735 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.737 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.737 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.738 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.739 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.755 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.756 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.756 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.756 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.758 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.775 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.776 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.777 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.777 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.778 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:21.975 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:21.976 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.976 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.976 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:21.978 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:22.135 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:22.136 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:22.136 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:22.136 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:22.138 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:22.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.141430 16308 heartbeater.cc:646] Failed to heartbeat to 127.15.100.60:34043 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:22.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.145109 16170 heartbeater.cc:646] Failed to heartbeat to 127.15.100.60:34043 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:22.315 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:22.317 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:22.317 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:22.317 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:22.319 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263; will retry
21:00:22.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.395475 16509 raft_consensus.cc:493] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c8bea0f8fd4eb89435e29afc5a2916)
21:00:22.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.395787 16509 raft_consensus.cc:515] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:22.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.395866 16510 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c8bea0f8fd4eb89435e29afc5a2916)
21:00:22.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.396036 16510 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.397277 16509 leader_election.cc:290] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bec699425da4353a2f5817a2c9e5d0c (127.15.100.62:45877), 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043)
21:00:22.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.397779 15811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "592d538b0f1a4705af37bf5a009afe52" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "7bec699425da4353a2f5817a2c9e5d0c" is_pre_election: true
21:00:22.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.398038 15811 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 592d538b0f1a4705af37bf5a009afe52 in term 1.
21:00:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.398711 15858 leader_election.cc:304] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 592d538b0f1a4705af37bf5a009afe52, 7bec699425da4353a2f5817a2c9e5d0c; no voters: 
21:00:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.398962 15857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111) [suppressed 4 similar messages]
21:00:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.399164 16509 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Leader pre-election won for term 2
21:00:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.399302 16509 raft_consensus.cc:493] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c8bea0f8fd4eb89435e29afc5a2916)
21:00:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.399452 16509 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 1 FOLLOWER]: Advancing to term 2
21:00:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.399448 15883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7bec699425da4353a2f5817a2c9e5d0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "592d538b0f1a4705af37bf5a009afe52" is_pre_election: true
21:00:22.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.402279 16510 leader_election.cc:290] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 592d538b0f1a4705af37bf5a009afe52 (127.15.100.61:42263), 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043)
21:00:22.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.402678 15786 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111) [suppressed 7 similar messages]
21:00:22.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.403153 16509 raft_consensus.cc:515] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:22.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.403785 15883 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7bec699425da4353a2f5817a2c9e5d0c in current term 2: Already voted for candidate 592d538b0f1a4705af37bf5a009afe52 in this term.
21:00:22.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.404309 15857 leader_election.cc:336] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043): Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:22.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.404457 16509 leader_election.cc:290] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [CANDIDATE]: Term 2 election: Requested vote from peers 7bec699425da4353a2f5817a2c9e5d0c (127.15.100.62:45877), 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043)
21:00:22.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.404608 15811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "592d538b0f1a4705af37bf5a009afe52" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "7bec699425da4353a2f5817a2c9e5d0c"
21:00:22.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.404816 15811 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 1 FOLLOWER]: Advancing to term 2
21:00:22.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.405355 15786 leader_election.cc:336] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043): Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:22.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.405783 15786 leader_election.cc:304] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7bec699425da4353a2f5817a2c9e5d0c; no voters: 21c8bea0f8fd4eb89435e29afc5a2916, 592d538b0f1a4705af37bf5a009afe52
21:00:22.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.406492 15857 leader_election.cc:336] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043): Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111)
21:00:22.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.407645 15811 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 592d538b0f1a4705af37bf5a009afe52 in term 2.
21:00:22.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.407858 16510 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
21:00:22.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.408079 15858 leader_election.cc:304] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 592d538b0f1a4705af37bf5a009afe52, 7bec699425da4353a2f5817a2c9e5d0c; no voters: 21c8bea0f8fd4eb89435e29afc5a2916
21:00:22.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.408375 16509 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 2 FOLLOWER]: Leader election won for term 2
21:00:22.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.408847 16509 raft_consensus.cc:697] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [term 2 LEADER]: Becoming Leader. State: Replica: 592d538b0f1a4705af37bf5a009afe52, State: Running, Role: LEADER
21:00:22.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.409289 16509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } }
21:00:22.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.410828 16515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 592d538b0f1a4705af37bf5a009afe52. Latest consensus state: current_term: 2 leader_uuid: "592d538b0f1a4705af37bf5a009afe52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:22.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.411077 16515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: This master's current role is: LEADER
21:00:22.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.411820 16517 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
21:00:22.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.414356 16517 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b]
21:00:22.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.416033 16517 tablet_loader.cc:96] loaded metadata for tablet 4adaa6ec4e5645bab565b20c2c941637 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b])
21:00:22.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.416276 16517 catalog_manager.cc:1519] Initializing Kudu cluster ID...
21:00:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.417019 16517 catalog_manager.cc:1294] Loaded cluster ID: 43c8dccd5912472f86a451ffa4a1dd89
21:00:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.417100 16517 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
21:00:22.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.418131 16517 catalog_manager.cc:1539] Loading token signing keys...
21:00:22.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.418913 16517 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: Loaded TSK: 0
21:00:22.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.419786 16517 catalog_manager.cc:1549] Initializing in-progress tserver states...
21:00:22.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.717603 16518 raft_consensus.cc:493] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b50e1b262194523994958c991e39de4)
21:00:22.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.717800 16518 raft_consensus.cc:515] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:22.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.719414 16518 leader_election.cc:290] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249), 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:22.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.720649 16195 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111)
21:00:22.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.722586 16195 leader_election.cc:336] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249): Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111)
21:00:22.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.723210 16523 raft_consensus.cc:493] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b50e1b262194523994958c991e39de4)
21:00:22.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.723448 16523 raft_consensus.cc:515] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:22.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.725386 16523 leader_election.cc:290] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31b21adc95e345918aee87a13455750c (127.15.100.2:43645), 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249)
21:00:22.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.727065 16057 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111)
21:00:22.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.728566 16125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "31b21adc95e345918aee87a13455750c" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "20b12687f62442b980845cfdd35b31ee" is_pre_election: true
21:00:22.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.728813 16125 raft_consensus.cc:2468] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31b21adc95e345918aee87a13455750c in term 1.
21:00:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.729383 16198 leader_election.cc:304] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20b12687f62442b980845cfdd35b31ee, 31b21adc95e345918aee87a13455750c; no voters: 0b50e1b262194523994958c991e39de4
21:00:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.729671 16057 leader_election.cc:336] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249): Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111)
21:00:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.729833 16518 raft_consensus.cc:2804] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Leader pre-election won for term 2
21:00:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.729972 16518 raft_consensus.cc:493] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b50e1b262194523994958c991e39de4)
21:00:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.730101 16518 raft_consensus.cc:3060] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 1 FOLLOWER]: Advancing to term 2
21:00:22.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.733274 16518 raft_consensus.cc:515] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:22.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.734004 16518 leader_election.cc:290] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [CANDIDATE]: Term 2 election: Requested vote from peers 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249), 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377)
21:00:22.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.734210 16263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "20b12687f62442b980845cfdd35b31ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "31b21adc95e345918aee87a13455750c" is_pre_election: true
21:00:22.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.734503 16125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4adaa6ec4e5645bab565b20c2c941637" candidate_uuid: "31b21adc95e345918aee87a13455750c" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "20b12687f62442b980845cfdd35b31ee"
21:00:22.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.734567 16263 raft_consensus.cc:2393] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20b12687f62442b980845cfdd35b31ee in current term 2: Already voted for candidate 31b21adc95e345918aee87a13455750c in this term.
21:00:22.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.734632 16125 raft_consensus.cc:3060] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 1 FOLLOWER]: Advancing to term 2
21:00:22.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.735782 16195 leader_election.cc:336] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249): Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111)
21:00:22.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.735821 16058 leader_election.cc:304] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20b12687f62442b980845cfdd35b31ee; no voters: 0b50e1b262194523994958c991e39de4, 31b21adc95e345918aee87a13455750c
21:00:22.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.737671 16125 raft_consensus.cc:2468] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31b21adc95e345918aee87a13455750c in term 2.
21:00:22.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.737905 16523 raft_consensus.cc:2749] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
21:00:22.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.738147 16198 leader_election.cc:304] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20b12687f62442b980845cfdd35b31ee, 31b21adc95e345918aee87a13455750c; no voters: 0b50e1b262194523994958c991e39de4
21:00:22.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.738572 16518 raft_consensus.cc:2804] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 2 FOLLOWER]: Leader election won for term 2
21:00:22.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.739085 16518 raft_consensus.cc:697] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 2 LEADER]: Becoming Leader. State: Replica: 31b21adc95e345918aee87a13455750c, State: Running, Role: LEADER
21:00:22.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.739725 16518 consensus_queue.cc:237] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } }
21:00:22.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.744372 15872 catalog_manager.cc:5696] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c reported cstate change: term changed from 1 to 2, leader changed from 0b50e1b262194523994958c991e39de4 (127.15.100.3) to 31b21adc95e345918aee87a13455750c (127.15.100.2). New cstate: current_term: 2 leader_uuid: "31b21adc95e345918aee87a13455750c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31b21adc95e345918aee87a13455750c" member_type: VOTER last_known_addr { host: "127.15.100.2" port: 43645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b50e1b262194523994958c991e39de4" member_type: VOTER last_known_addr { host: "127.15.100.3" port: 34249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 } health_report { overall_health: UNKNOWN } } }
21:00:22.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.752406 15811 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [term 2 FOLLOWER]: Refusing update from remote peer 592d538b0f1a4705af37bf5a009afe52: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
21:00:22.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:22.753055 15857 consensus_peers.cc:597] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 -> Peer 21c8bea0f8fd4eb89435e29afc5a2916 (127.15.100.60:34043): Couldn't send request to peer 21c8bea0f8fd4eb89435e29afc5a2916. Status: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
21:00:22.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.753297 16515 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
21:00:22.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.755910 16510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 592d538b0f1a4705af37bf5a009afe52. Latest consensus state: current_term: 2 leader_uuid: "592d538b0f1a4705af37bf5a009afe52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:22.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.756147 16510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: This master's current role is: FOLLOWER
21:00:22.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.757989 16515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "592d538b0f1a4705af37bf5a009afe52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:22.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.758213 16515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52 [sys.catalog]: This master's current role is: LEADER
21:00:22.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.758297 16510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "592d538b0f1a4705af37bf5a009afe52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bec699425da4353a2f5817a2c9e5d0c" member_type: VOTER last_known_addr { host: "127.15.100.62" port: 45877 } } peers { permanent_uuid: "592d538b0f1a4705af37bf5a009afe52" member_type: VOTER last_known_addr { host: "127.15.100.61" port: 42263 } } peers { permanent_uuid: "21c8bea0f8fd4eb89435e29afc5a2916" member_type: VOTER last_known_addr { host: "127.15.100.60" port: 34043 } } }
21:00:22.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.758580 16510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bec699425da4353a2f5817a2c9e5d0c [sys.catalog]: This master's current role is: FOLLOWER
21:00:22.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.774710 15771 master_runner.cc:187] Error getting master registration for 127.15.100.60:34043: Network error: Client connection negotiation failed: client connection to 127.15.100.60:34043: connect: Connection refused (error 111), 
21:00:22.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:22.774940 15771 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:23.015 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.15.100.60:34043(127.15.100.60:34043)] connecting to peer
21:00:23.016 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:23.016 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.100.60:34043(127.15.100.60:34043)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:23.016 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.15.100.60:34043: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043
21:00:23.019 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
21:00:23.021 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=29994, elapsed=1405), Traces: [0ms] sending RPC to server master-127.15.100.60:34043, [2ms] received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [19ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [23ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [24ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [27ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [43ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [46ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [46ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [62ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [63ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [64ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [82ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [83ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [84ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [124ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [124ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [124ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [125ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [142ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [143ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [144ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [144ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [163ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [163ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [164ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [164ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [360ms] refreshing cache from master, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [360ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [361ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [362ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [363ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [364ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [364ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [522ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [523ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [524ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [524ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [700ms] refreshing cache from master, [700ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [701ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [702ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [703ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [704ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [705ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [705ms] delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [1399ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [1402ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [1405ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, deferred=Deferred@827898479(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@1240639155 after retry RPC after error@1678058162) -> (continuation of Deferred@903393565 after retry RPC after error@1101528587) -> (continuation of Deferred@490479538 after retry RPC after error@1348578837) -> (continuation of Deferred@549567837 after retry RPC after error@1583892712) -> (continuation of Deferred@601103640 after retry RPC after error@2115509873) -> (continuation of Deferred@1394503610 after retry RPC after error@1336754745) -> (continuation of Deferred@1284684297 after retry RPC after error@1925701244) -> (continuation of Deferred@1375996961 after retry RPC after error@1998397650) -> (continuation of Deferred@772185802 after retry RPC after error@1652461896) -> (continuation of Deferred@283769890 after retry RPC after error@241976669), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1240639155 after retry RPC after error@1678058162) -> (continuation of Deferred@903393565 after retry RPC after error@1101528587) -> (continuation of Deferred@490479538 after retry RPC after error@1348578837) -> (continuation of Deferred@549567837 after retry RPC after error@1583892712) -> (continuation of Deferred@601103640 after retry RPC after error@2115509873) -> (continuation of Deferred@1394503610 after retry RPC after error@1336754745) -> (continuation of Deferred@1284684297 after retry RPC after error@1925701244) -> (continuation of Deferred@1375996961 after retry RPC after error@1998397650) -> (continuation of Deferred@772185802 after retry RPC after error@1652461896) -> (continuation of Deferred@283769890 after retry RPC after error@241976669))) after lookup
21:00:23.025 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4adaa6ec4e5645bab565b20c2c941637 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
21:00:23.026 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4adaa6ec4e5645bab565b20c2c941637@[0b50e1b262194523994958c991e39de4(127.15.100.3:34249),20b12687f62442b980845cfdd35b31ee(127.15.100.1:38377),31b21adc95e345918aee87a13455750c(127.15.100.2:43645)[L]]}]
21:00:23.028 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=4adaa6ec4e5645bab565b20c2c941637, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1418), Traces: [0ms] sending RPC to server 0b50e1b262194523994958c991e39de4, [3ms] received response from server 0b50e1b262194523994958c991e39de4: Network error: Failed to connect to peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249): Connection refused: /127.15.100.3:34249, [3ms] delaying RPC due to: Network error: Failed to connect to peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249): Connection refused: /127.15.100.3:34249, [6ms] refreshing cache from master, [7ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.100.60:34043, [9ms] Sub RPC GetTableLocations: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [9ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [26ms] Sub RPC GetTableLocations: refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [30ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [30ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [31ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [34ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [47ms] Sub RPC GetTableLocations: refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [50ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [51ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [53ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [53ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [66ms] Sub RPC GetTableLocations: refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [69ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [70ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [71ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [86ms] Sub RPC GetTableLocations: refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [88ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [89ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [90ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [91ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [91ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [127ms] Sub RPC GetTableLocations: refreshing cache from master, [127ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [128ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [131ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [131ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [131ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [132ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [147ms] Sub RPC GetTableLocations: refreshing cache from master, [147ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [149ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [150ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [151ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [151ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [167ms] Sub RPC GetTableLocations: refreshing cache from master, [167ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [170ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [170ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [171ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [171ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [367ms] Sub RPC GetTableLocations: refreshing cache from master, [367ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [367ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [368ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [369ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [370ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [371ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [371ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [527ms] Sub RPC GetTableLocations: refreshing cache from master, [527ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [528ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [528ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [529ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [530ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [531ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [531ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [707ms] Sub RPC GetTableLocations: refreshing cache from master, [707ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [708ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [709ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [710ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [711ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [712ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [712ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.15.100.62:45877,127.15.100.60:34043,127.15.100.61:42263) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [1406ms] Sub RPC GetTableLocations: refreshing cache from master, [1407ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.62:45877, [1407ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.60:34043, [1408ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.100.61:42263, [1409ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.60:34043: Network error: Failed to connect to peer master-127.15.100.60:34043(127.15.100.60:34043): Connection refused: /127.15.100.60:34043, [1410ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.62:45877: OK, [1412ms] Sub RPC ConnectToMaster: received response from server master-127.15.100.61:42263: OK, [1415ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.100.61:42263, [1418ms] Sub RPC GetTableLocations: received response from server master-127.15.100.61:42263: OK, deferred=Deferred@48520605(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@5d33a90f -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@31194959 -> wakeup thread Time-limited test)) after lookup
21:00:23.028 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 31b21adc95e345918aee87a13455750c(127.15.100.2:43645)] connecting to peer
21:00:23.030 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 31b21adc95e345918aee87a13455750c(127.15.100.2:43645)] Successfully connected to peer
21:00:23.051 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe4f878de, L:/127.0.0.1:57732 - R:/127.15.100.2:43645] using TOKEN/null
21:00:23.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.057535 16125 raft_consensus.cc:1275] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 2 FOLLOWER]: Refusing update from remote peer 31b21adc95e345918aee87a13455750c: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
21:00:23.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.058328 16528 consensus_queue.cc:1048] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [LEADER]: Connected to new peer: Peer: permanent_uuid: "20b12687f62442b980845cfdd35b31ee" member_type: VOTER last_known_addr { host: "127.15.100.1" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
21:00:23.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:23.058836 16195 consensus_peers.cc:597] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c -> Peer 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249): Couldn't send request to peer 0b50e1b262194523994958c991e39de4. Status: Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
21:00:23.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.070968 16310 heartbeater.cc:499] Master 127.15.100.61:42263 was elected leader, sending a full tablet report...
21:00:23.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.074332 16172 heartbeater.cc:499] Master 127.15.100.61:42263 was elected leader, sending a full tablet report...
21:00:23.157 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=4adaa6ec4e5645bab565b20c2c941637, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
21:00:23.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.162940 15872 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50876:
21:00:23.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
21:00:23.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.163300 15872 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50876:
21:00:23.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
21:00:23.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.173385 15872 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 592d538b0f1a4705af37bf5a009afe52: Sending DeleteTablet for 3 replicas of tablet 4adaa6ec4e5645bab565b20c2c941637
21:00:23.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.185038 16243 tablet_service.cc:1558] Processing DeleteTablet for tablet 4adaa6ec4e5645bab565b20c2c941637 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 21:00:23 UTC) from {username='slave'} at 127.0.0.1:57740
21:00:23.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.196920 16545 tablet_replica.cc:333] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: stopping tablet replica
21:00:23.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.197436 16545 raft_consensus.cc:2243] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 2 LEADER]: Raft consensus shutting down.
21:00:23.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.198572 16545 raft_consensus.cc:2272] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c [term 2 FOLLOWER]: Raft consensus is shut down!
21:00:23.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.198594 16105 tablet_service.cc:1558] Processing DeleteTablet for tablet 4adaa6ec4e5645bab565b20c2c941637 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 21:00:23 UTC) from {username='slave'} at 127.0.0.1:55116
21:00:23.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.200541 16545 ts_tablet_manager.cc:1916] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Deleting tablet data with delete state TABLET_DATA_DELETED
21:00:23.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.208793 16545 ts_tablet_manager.cc:1929] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
21:00:23.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.209239 16545 log.cc:1199] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Deleting WAL directory at /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-1/wal/wals/4adaa6ec4e5645bab565b20c2c941637
21:00:23.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.210026 16545 ts_tablet_manager.cc:1950] T 4adaa6ec4e5645bab565b20c2c941637 P 31b21adc95e345918aee87a13455750c: Deleting consensus metadata
21:00:23.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.212405 15858 catalog_manager.cc:5027] TS 31b21adc95e345918aee87a13455750c (127.15.100.2:43645): tablet 4adaa6ec4e5645bab565b20c2c941637 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b]) successfully deleted
21:00:23.225 [DEBUG - main] (Connection.java:575) [peer master-127.15.100.62:45877(127.15.100.62:45877)] disconnecting while in state READY
21:00:23.226 [DEBUG - main] (Connection.java:575) [peer 0b50e1b262194523994958c991e39de4(127.15.100.3:34249)] disconnecting while in state TERMINATED
21:00:23.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.222525 16546 tablet_replica.cc:333] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: stopping tablet replica
21:00:23.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.223031 16546 raft_consensus.cc:2243] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 2 FOLLOWER]: Raft consensus shutting down.
21:00:23.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.223699 16546 raft_consensus.cc:2272] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee [term 2 FOLLOWER]: Raft consensus is shut down!
21:00:23.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.226289 16546 ts_tablet_manager.cc:1916] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Deleting tablet data with delete state TABLET_DATA_DELETED
21:00:23.229 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.100.62:45877(127.15.100.62:45877)] handling channelInactive
21:00:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:23.229460 15857 catalog_manager.cc:4754] TS 0b50e1b262194523994958c991e39de4 (127.15.100.3:34249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4adaa6ec4e5645bab565b20c2c941637: Network error: Client connection negotiation failed: client connection to 127.15.100.3:34249: connect: Connection refused (error 111)
21:00:23.229 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.100.62:45877(127.15.100.62:45877)] cleaning up while in state READY due to: connection closed
21:00:23.230 [DEBUG - main] (Connection.java:575) [peer master-127.15.100.61:42263(127.15.100.61:42263)] disconnecting while in state READY
21:00:23.230 [DEBUG - main] (Connection.java:575) [peer master-127.15.100.60:34043(127.15.100.60:34043)] disconnecting while in state TERMINATED
21:00:23.230 [DEBUG - main] (Connection.java:575) [peer 31b21adc95e345918aee87a13455750c(127.15.100.2:43645)] disconnecting while in state READY
21:00:23.231 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.100.61:42263(127.15.100.61:42263)] handling channelInactive
21:00:23.231 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.100.61:42263(127.15.100.61:42263)] cleaning up while in state READY due to: connection closed
21:00:23.231 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 31b21adc95e345918aee87a13455750c(127.15.100.2:43645)] handling channelInactive
21:00:23.231 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 31b21adc95e345918aee87a13455750c(127.15.100.2:43645)] cleaning up while in state READY due to: connection closed
21:00:23.232 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
21:00:23.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.234633 16546 ts_tablet_manager.cc:1929] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
21:00:23.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.234943 16546 log.cc:1199] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Deleting WAL directory at /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster18042302292292066312/ts-0/wal/wals/4adaa6ec4e5645bab565b20c2c941637
21:00:23.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.235615 16546 ts_tablet_manager.cc:1950] T 4adaa6ec4e5645bab565b20c2c941637 P 20b12687f62442b980845cfdd35b31ee: Deleting consensus metadata
21:00:23.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.237483 15860 catalog_manager.cc:5027] TS 20b12687f62442b980845cfdd35b31ee (127.15.100.1:38377): tablet 4adaa6ec4e5645bab565b20c2c941637 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=f634ff7b05ec466bae8467fe70f53f6b]) successfully deleted
21:00:23.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.239188 15760 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16042
21:00:23.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.253775 16165 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:23.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.376333 15760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16042
21:00:23.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.395015 15760 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16180
21:00:23.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.403390 16303 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:23.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.518859 15760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16180
21:00:23.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.538110 15760 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 15771
21:00:23.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.539382 15832 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:23.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.646750 15760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 15771
21:00:23.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.667022 15760 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 15839
21:00:23.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.668344 15903 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:23.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:23.778404 15760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 15839
21:00:23.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T21:00:23Z chronyd exiting
.21:00:23.930 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783544423930
21:00:23.933 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
21:00:23.933 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
21:00:23.933 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskOoRw2s/test-tmp
21:00:23.934 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
21:00:23.934 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskOoRw2s/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
21:00:23.937 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

21:00:24.267 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
21:00:24.268 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

21:00:24.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.270377 16556 mini_oidc.cc:150] Starting JWKS server
21:00:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.273231 16556 webserver.cc:534] Webserver started at http://127.0.0.1:41507/ using document root <none> and password file <none>
21:00:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.273572 16556 mini_oidc.cc:186] Starting OIDC Discovery server
21:00:24.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.274207 16556 webserver.cc:534] Webserver started at http://127.0.0.1:46127/ using document root <none> and password file <none>
21:00:24.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T21:00:24Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
21:00:24.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T21:00:24Z Disabled control of system clock
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.303819 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/logs
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/info.pb
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.62:32775
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.62
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json with env {}
21:00:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.630039 16567 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.630355 16567 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:24.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.630442 16567 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:24.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.638579 16567 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:24.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.638679 16567 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:24.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.638738 16567 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:24.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.638827 16567 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:24.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.638911 16567 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:24.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.638963 16567 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41507/jwks.json
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.648947 16567 master_runner.cc:387] Master server non-default flags:
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.62:32775
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/info.pb
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.62
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:24.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/logs
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.650588 16567 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:24.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.652312 16567 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.660923 16573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.661031 16575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.661033 16572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:24.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.662127 16567 server_base.cc:1061] running on GCE node
21:00:24.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.662900 16567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:24.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.664435 16567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:24.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.665643 16567 hybrid_clock.cc:648] HybridClock initialized: now 1783544424665592 us; error 49 us; skew 500 ppm
21:00:24.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.665967 16567 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:24.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.668251 16567 webserver.cc:534] Webserver started at http://127.16.43.62:41391/ using document root <none> and password file <none>
21:00:24.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.668939 16567 fs_manager.cc:362] Metadata directory not provided
21:00:24.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.669024 16567 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:24.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.669329 16567 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.671741 16567 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/instance:
21:00:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bc3819effe8f4e0e85479d2675d58272"
21:00:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:24 on dist-test-slave-xb7w"
21:00:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.672588 16567 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal/instance:
21:00:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bc3819effe8f4e0e85479d2675d58272"
21:00:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:24 on dist-test-slave-xb7w"
21:00:24.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.677955 16567 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
21:00:24.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.681576 16581 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.682948 16567 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.683141 16567 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bc3819effe8f4e0e85479d2675d58272"
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:24 on dist-test-slave-xb7w"
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.683434 16567 fs_report.cc:389] FS layout report
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/data
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:24.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:24.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:24.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.697783 16567 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:24.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.698798 16567 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:24.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.699170 16567 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.720024 16567 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.62:32775
21:00:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.720060 16632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.62:32775 every 8 connection(s)
21:00:24.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.721698 16567 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/info.pb
21:00:24.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.726292 16633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:24.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.731585 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16567
21:00:24.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.731949 16556 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal/instance
21:00:24.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.733816 16633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } has no permanent_uuid. Determining permanent_uuid...
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.735239 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/logs
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data/info.pb
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.61:35389
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.61
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json with env {}
21:00:24.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.752708 16633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } has no permanent_uuid. Determining permanent_uuid...
21:00:24.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.754036 16582 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.43.61:35389: connect: Connection refused (error 111)
21:00:24.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.755965 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.61:35389: Network error: Client connection negotiation failed: client connection to 127.16.43.61:35389: connect: Connection refused (error 111)
21:00:24.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.805409 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } attempt: 1
21:00:24.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.807837 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.61:35389: Network error: Client connection negotiation failed: client connection to 127.16.43.61:35389: connect: Connection refused (error 111)
21:00:24.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.876155 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } attempt: 2
21:00:24.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.878412 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.61:35389: Network error: Client connection negotiation failed: client connection to 127.16.43.61:35389: connect: Connection refused (error 111)
21:00:24.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:24.969710 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } attempt: 3
21:00:24.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:24.972158 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.61:35389: Network error: Client connection negotiation failed: client connection to 127.16.43.61:35389: connect: Connection refused (error 111)
21:00:25.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.080621 16637 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:25.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.080996 16637 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:25.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.081125 16637 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:25.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.089715 16637 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:25.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.089855 16637 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:25.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.089934 16637 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:25.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.089990 16637 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:25.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.090063 16637 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:25.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.090119 16637 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41507/jwks.json
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.100690 16637 master_runner.cc:387] Master server non-default flags:
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.61:35389
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data/info.pb
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.61
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:25.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/logs
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:25.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:25.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.102886 16637 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:25.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.104768 16637 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:25.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.113255 16643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:25.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.113286 16644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:25.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.113832 16646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:25.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.114694 16637 server_base.cc:1061] running on GCE node
21:00:25.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.115559 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } attempt: 4
21:00:25.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.115741 16637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.117441 16637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.117601 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.61:35389: Network error: Client connection negotiation failed: client connection to 127.16.43.61:35389: connect: Connection refused (error 111)
21:00:25.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.118680 16637 hybrid_clock.cc:648] HybridClock initialized: now 1783544425118589 us; error 78 us; skew 500 ppm
21:00:25.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.119021 16637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:25.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.121307 16637 webserver.cc:534] Webserver started at http://127.16.43.61:33845/ using document root <none> and password file <none>
21:00:25.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.121999 16637 fs_manager.cc:362] Metadata directory not provided
21:00:25.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.122085 16637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:25.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.122375 16637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:25.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.124747 16637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data/instance:
21:00:25.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f899c782a9245d7b63eb78d1f111da3"
21:00:25.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:25 on dist-test-slave-xb7w"
21:00:25.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.125490 16637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal/instance:
21:00:25.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f899c782a9245d7b63eb78d1f111da3"
21:00:25.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:25 on dist-test-slave-xb7w"
21:00:25.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.130623 16637 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
21:00:25.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.134016 16652 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.135456 16637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.135593 16637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f899c782a9245d7b63eb78d1f111da3"
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:25 on dist-test-slave-xb7w"
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.135756 16637 fs_report.cc:389] FS layout report
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:25.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data/data
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.151989 16637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:25.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.152752 16637 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:25.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.152990 16637 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:25.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.173846 16637 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.61:35389
21:00:25.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.173887 16703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.61:35389 every 8 connection(s)
21:00:25.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.175415 16637 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/data/info.pb
21:00:25.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.175887 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16637
21:00:25.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.176069 16556 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-1/wal/instance
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.177203 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/logs
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data/info.pb
21:00:25.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.60:37825
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.60
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json with env {}
21:00:25.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.180277 16704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:25.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.189272 16704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.203604 16704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.212723 16704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.213737 16653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.215372 16704 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.264710 16704 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 1
21:00:25.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.266870 16704 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.335124 16704 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 2
21:00:25.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.337395 16704 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.416852 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } attempt: 5
21:00:25.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.423425 16633 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.425384 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.428639 16704 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 3
21:00:25.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.430526 16704 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.476603 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 1
21:00:25.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.478783 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.532683 16706 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.533046 16706 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:25.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.533162 16706 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.544268 16706 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.544450 16706 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.544553 16706 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.544617 16706 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.544691 16706 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:25.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.544744 16706 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41507/jwks.json
21:00:25.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.547042 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 2
21:00:25.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.549448 16633 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.556274 16706 master_runner.cc:387] Master server non-default flags:
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:25.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.60:37825
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data/info.pb
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.60
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/logs
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:25.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:25.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:25.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.558429 16706 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:25.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.560349 16706 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:25.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.568442 16714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.569218 16715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:25.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.569712 16717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:25.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.570767 16706 server_base.cc:1061] running on GCE node
21:00:25.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.571640 16706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:25.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.573035 16706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:25.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.573729 16704 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 4
21:00:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.574283 16706 hybrid_clock.cc:648] HybridClock initialized: now 1783544425574233 us; error 29 us; skew 500 ppm
21:00:25.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.574728 16706 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:25.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.575716 16704 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.16.43.60:37825: Network error: Client connection negotiation failed: client connection to 127.16.43.60:37825: connect: Connection refused (error 111)
21:00:25.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.577169 16706 webserver.cc:534] Webserver started at http://127.16.43.60:46499/ using document root <none> and password file <none>
21:00:25.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.577890 16706 fs_manager.cc:362] Metadata directory not provided
21:00:25.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.577984 16706 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:25.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.578279 16706 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.580706 16706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data/instance:
21:00:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "308348fa438b44acbd4f2db48ec3c0fc"
21:00:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:25 on dist-test-slave-xb7w"
21:00:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.581447 16706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal/instance:
21:00:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "308348fa438b44acbd4f2db48ec3c0fc"
21:00:25.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:25 on dist-test-slave-xb7w"
21:00:25.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.586706 16706 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
21:00:25.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.590234 16723 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.591835 16706 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.591980 16706 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "308348fa438b44acbd4f2db48ec3c0fc"
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:25 on dist-test-slave-xb7w"
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.592163 16706 fs_report.cc:389] FS layout report
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data/data
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:25.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:25.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:25.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.630611 16706 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:25.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.631605 16706 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:25.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.631851 16706 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.652907 16706 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.60:37825
21:00:25.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.652940 16774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.60:37825 every 8 connection(s)
21:00:25.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.654405 16706 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/data/info.pb
21:00:25.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.655681 16633 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 3
21:00:25.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.656554 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16706
21:00:25.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.656762 16556 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-2/wal/instance
21:00:25.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.659296 16775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:25.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.668005 16775 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.679747 16633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Bootstrap starting.
21:00:25.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.680598 16775 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.683863 16633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Neither blocks nor log segments found. Creating new log.
21:00:25.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.684949 16633 log.cc:826] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Log is configured to *not* fsync() on all Append() calls
21:00:25.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.688314 16633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: No bootstrap required, opened a new log
21:00:25.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.692270 16775 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } has no permanent_uuid. Determining permanent_uuid...
21:00:25.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.697252 16633 raft_consensus.cc:359] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:25.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.697638 16633 raft_consensus.cc:385] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:25.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.697770 16633 raft_consensus.cc:740] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc3819effe8f4e0e85479d2675d58272, State: Initialized, Role: FOLLOWER
21:00:25.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.698550 16633 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:25.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.699719 16784 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:25.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.700044 16784 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: FOLLOWER
21:00:25.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.701092 16633 sys_catalog.cc:565] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: configured and running, proceeding with master startup.
21:00:25.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.702126 16587 tablet.cc:2406] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:25.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.704942 16775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: Bootstrap starting.
21:00:25.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.708746 16775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: Neither blocks nor log segments found. Creating new log.
21:00:25.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.709990 16775 log.cc:826] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: Log is configured to *not* fsync() on all Append() calls
21:00:25.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.712837 16775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: No bootstrap required, opened a new log
21:00:25.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.719929 16796 catalog_manager.cc:1593] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
21:00:25.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.720314 16796 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
21:00:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.722250 16775 raft_consensus.cc:359] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.722646 16775 raft_consensus.cc:385] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:25.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.722785 16775 raft_consensus.cc:740] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308348fa438b44acbd4f2db48ec3c0fc, State: Initialized, Role: FOLLOWER
21:00:25.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.723555 16775 consensus_queue.cc:260] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:25.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.717303 16567 master_runner.cc:187] Error getting master registration for 127.16.43.61:35389: OK, instance_id { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" instance_seqno: 1783544425167984 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
21:00:25.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.724658 16567 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:25.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.725394 16798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:25.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.725879 16798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: This master's current role is: FOLLOWER
21:00:25.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.726733 16775 sys_catalog.cc:565] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: configured and running, proceeding with master startup.
21:00:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.740594 16809 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
21:00:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.743058 16809 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
21:00:25.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.743352 16706 master_runner.cc:187] Error getting master registration for 127.16.43.61:35389: OK, instance_id { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" instance_seqno: 1783544425167984 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
21:00:25.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.747699 16706 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:25.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.874975 16704 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } attempt: 5
21:00:25.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.884052 16729 tablet.cc:2406] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:25.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.888373 16704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: Bootstrap starting.
21:00:25.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.892643 16704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: Neither blocks nor log segments found. Creating new log.
21:00:25.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.893962 16704 log.cc:826] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: Log is configured to *not* fsync() on all Append() calls
21:00:25.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.897825 16704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: No bootstrap required, opened a new log
21:00:25.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.905432 16704 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:25.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.905979 16704 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:25.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.906247 16704 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f899c782a9245d7b63eb78d1f111da3, State: Initialized, Role: FOLLOWER
21:00:25.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.907209 16704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.908283 16812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:25.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.908814 16812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: This master's current role is: FOLLOWER
21:00:25.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.909472 16704 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: configured and running, proceeding with master startup.
21:00:25.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.923678 16637 master_runner.cc:264] No leader master found from master 8f899c782a9245d7b63eb78d1f111da3
21:00:25.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:25.923820 16637 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.927874 16823 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
21:00:25.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:25.928297 16823 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
21:00:26.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.026952 16784 raft_consensus.cc:493] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
21:00:26.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.027787 16784 raft_consensus.cc:515] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:26.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.029913 16784 leader_election.cc:290] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f899c782a9245d7b63eb78d1f111da3 (127.16.43.61:35389), 308348fa438b44acbd4f2db48ec3c0fc (127.16.43.60:37825)
21:00:26.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.031935 16679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc3819effe8f4e0e85479d2675d58272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f899c782a9245d7b63eb78d1f111da3" is_pre_election: true
21:00:26.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.032547 16679 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc3819effe8f4e0e85479d2675d58272 in term 0.
21:00:26.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.033576 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc3819effe8f4e0e85479d2675d58272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308348fa438b44acbd4f2db48ec3c0fc" is_pre_election: true
21:00:26.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.034128 16750 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc3819effe8f4e0e85479d2675d58272 in term 0.
21:00:26.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.035727 16582 leader_election.cc:304] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f899c782a9245d7b63eb78d1f111da3, bc3819effe8f4e0e85479d2675d58272; no voters: 
21:00:26.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.036855 16784 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Leader pre-election won for term 1
21:00:26.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.037036 16784 raft_consensus.cc:493] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
21:00:26.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.037156 16784 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 0 FOLLOWER]: Advancing to term 1
21:00:26.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.044574 16784 raft_consensus.cc:515] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:26.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.046118 16679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc3819effe8f4e0e85479d2675d58272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f899c782a9245d7b63eb78d1f111da3"
21:00:26.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.046366 16679 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 0 FOLLOWER]: Advancing to term 1
21:00:26.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.051133 16679 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc3819effe8f4e0e85479d2675d58272 in term 1.
21:00:26.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.051913 16582 leader_election.cc:304] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f899c782a9245d7b63eb78d1f111da3, bc3819effe8f4e0e85479d2675d58272; no voters: 
21:00:26.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.053622 16784 leader_election.cc:290] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [CANDIDATE]: Term 1 election: Requested vote from peers 8f899c782a9245d7b63eb78d1f111da3 (127.16.43.61:35389), 308348fa438b44acbd4f2db48ec3c0fc (127.16.43.60:37825)
21:00:26.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.054476 16784 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 FOLLOWER]: Leader election won for term 1
21:00:26.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.055116 16784 raft_consensus.cc:697] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 LEADER]: Becoming Leader. State: Replica: bc3819effe8f4e0e85479d2675d58272, State: Running, Role: LEADER
21:00:26.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.056190 16784 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:26.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.065196 16750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc3819effe8f4e0e85479d2675d58272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308348fa438b44acbd4f2db48ec3c0fc"
21:00:26.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.065454 16750 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 0 FOLLOWER]: Advancing to term 1
21:00:26.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.069240 16750 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc3819effe8f4e0e85479d2675d58272 in term 1.
21:00:26.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.079121 16825 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc3819effe8f4e0e85479d2675d58272. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.079914 16825 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: LEADER
21:00:26.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.084154 16827 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
21:00:26.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.086963 16827 catalog_manager.cc:1519] Initializing Kudu cluster ID...
21:00:26.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.104539 16750 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Refusing update from remote peer bc3819effe8f4e0e85479d2675d58272: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:26.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.110145 16825 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:26.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.118562 16679 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 1 FOLLOWER]: Refusing update from remote peer bc3819effe8f4e0e85479d2675d58272: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:26.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.119921 16825 consensus_queue.cc:1048] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:26.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.155405 16658 tablet.cc:2406] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:26.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.160719 16812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc3819effe8f4e0e85479d2675d58272. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.161070 16812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: This master's current role is: FOLLOWER
21:00:26.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.170329 16830 mvcc.cc:204] Tried to move back new op lower bound from 7305397969308827648 to 7305397969141129216. Current Snapshot: MvccSnapshot[applied={T|T < 7305397969308827648}]
21:00:26.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.172140 16828 mvcc.cc:204] Tried to move back new op lower bound from 7305397969308827648 to 7305397969141129216. Current Snapshot: MvccSnapshot[applied={T|T < 7305397969308827648}]
21:00:26.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.172860 16784 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.173117 16784 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: LEADER
21:00:26.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.175357 16827 catalog_manager.cc:1382] Generated new cluster ID: 5fd93db9b2ec4b8aaa6adc6911737c90
21:00:26.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.175464 16827 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
21:00:26.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.191380 16798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc3819effe8f4e0e85479d2675d58272. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.191712 16798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: This master's current role is: FOLLOWER
21:00:26.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.197731 16812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.197969 16812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: This master's current role is: FOLLOWER
21:00:26.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.217434 16829 mvcc.cc:204] Tried to move back new op lower bound from 7305397969308827648 to 7305397969141129216. Current Snapshot: MvccSnapshot[applied={T|T < 7305397969308827648}]
21:00:26.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.237824 16798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.238065 16798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: This master's current role is: FOLLOWER
21:00:26.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.247025 16835 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bc3819effe8f4e0e85479d2675d58272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:26.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.247972 16827 catalog_manager.cc:1405] Generated new certificate authority record
21:00:26.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.248492 16835 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: LEADER
21:00:26.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.249751 16827 catalog_manager.cc:1539] Loading token signing keys...
21:00:26.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.276907 16827 catalog_manager.cc:6069] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Generated new TSK 0
21:00:26.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.278083 16827 catalog_manager.cc:1549] Initializing in-progress tserver states...
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.311085 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/logs
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data/info.pb
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:26.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.1:0
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.43.1
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.1
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:26.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
21:00:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.663643 16839 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.664002 16839 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.664120 16839 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:26.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.672686 16839 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:26.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.672906 16839 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.43.1
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.683277 16839 tablet_server_runner.cc:78] Tablet server non-default flags:
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:26.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.1:0
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data/info.pb
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.1
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.43.1
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/logs
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:26.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:26.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.685372 16839 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:26.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.687256 16839 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:26.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.697173 16844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:26.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.697603 16847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:26.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:26.697144 16845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:26.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.698570 16839 server_base.cc:1061] running on GCE node
21:00:26.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.699240 16839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:26.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.700281 16839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:26.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.701551 16839 hybrid_clock.cc:648] HybridClock initialized: now 1783544426701499 us; error 69 us; skew 500 ppm
21:00:26.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.701907 16839 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:26.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.704277 16839 webserver.cc:534] Webserver started at http://127.16.43.1:38555/ using document root <none> and password file <none>
21:00:26.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.705108 16839 fs_manager.cc:362] Metadata directory not provided
21:00:26.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.705243 16839 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:26.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.705632 16839 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:26.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.708148 16839 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data/instance:
21:00:26.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "503038f9153f4530887311fde976e6d1"
21:00:26.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:26 on dist-test-slave-xb7w"
21:00:26.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.708995 16839 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal/instance:
21:00:26.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "503038f9153f4530887311fde976e6d1"
21:00:26.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:26 on dist-test-slave-xb7w"
21:00:26.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.714684 16839 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
21:00:26.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.718379 16853 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.719929 16839 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.720088 16839 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "503038f9153f4530887311fde976e6d1"
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:26 on dist-test-slave-xb7w"
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.720292 16839 fs_report.cc:389] FS layout report
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data/data
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:26.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:26.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:26.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.745366 16809 catalog_manager.cc:1294] Loaded cluster ID: 5fd93db9b2ec4b8aaa6adc6911737c90
21:00:26.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.745466 16809 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: loading cluster ID for follower catalog manager: success
21:00:26.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.748334 16809 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: acquiring CA information for follower catalog manager: success
21:00:26.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.750172 16809 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
21:00:26.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.766993 16839 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:26.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.767983 16839 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:26.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.768325 16839 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:26.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.769436 16839 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
21:00:26.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.771248 16839 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
21:00:26.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.771375 16839 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
21:00:26.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.771484 16839 ts_tablet_manager.cc:616] Registered 0 tablets
21:00:26.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.771561 16839 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
21:00:26.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.807612 16839 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.1:34435
21:00:26.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.807701 16965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.1:34435 every 8 connection(s)
21:00:26.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.809141 16839 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/data/info.pb
21:00:26.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.814540 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16839
21:00:26.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.814749 16556 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-0/wal/instance
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.819751 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/logs
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data/info.pb
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:26.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.2:0
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.43.2
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.2
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:26.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
21:00:26.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.838788 16967 heartbeater.cc:344] Connected to a master server at 127.16.43.62:32775
21:00:26.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.839164 16967 heartbeater.cc:461] Registering TS with master...
21:00:26.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.840363 16967 heartbeater.cc:507] Master 127.16.43.62:32775 requested a full tablet report, sending...
21:00:26.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.842935 16968 heartbeater.cc:344] Connected to a master server at 127.16.43.61:35389
21:00:26.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.843003 16597 ts_manager.cc:194] Registered new tserver with Master: 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435)
21:00:26.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.843127 16968 heartbeater.cc:461] Registering TS with master...
21:00:26.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.843708 16968 heartbeater.cc:507] Master 127.16.43.61:35389 requested a full tablet report, sending...
21:00:26.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.845469 16597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.43.1:57549
21:00:26.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.845973 16669 ts_manager.cc:194] Registered new tserver with Master: 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435)
21:00:26.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.846158 16966 heartbeater.cc:344] Connected to a master server at 127.16.43.60:37825
21:00:26.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.846251 16966 heartbeater.cc:461] Registering TS with master...
21:00:26.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.846673 16966 heartbeater.cc:507] Master 127.16.43.60:37825 requested a full tablet report, sending...
21:00:26.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.848273 16740 ts_manager.cc:194] Registered new tserver with Master: 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435)
21:00:26.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.930305 16823 catalog_manager.cc:1294] Loaded cluster ID: 5fd93db9b2ec4b8aaa6adc6911737c90
21:00:26.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.930474 16823 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: loading cluster ID for follower catalog manager: success
21:00:26.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.933137 16823 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: acquiring CA information for follower catalog manager: success
21:00:26.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:26.934899 16823 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
21:00:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.154057 16975 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.154367 16975 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:27.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.154449 16975 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:27.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.163990 16975 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:27.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.164170 16975 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.43.2
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.174929 16975 tablet_server_runner.cc:78] Tablet server non-default flags:
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.2:0
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data/info.pb
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.2
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.43.2
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/logs
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:27.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.176513 16975 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:27.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.178175 16975 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:27.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.187638 16981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:27.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.187996 16982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:27.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.188388 16984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:27.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.191104 16975 server_base.cc:1061] running on GCE node
21:00:27.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.191756 16975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:27.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.192698 16975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:27.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.193921 16975 hybrid_clock.cc:648] HybridClock initialized: now 1783544427193870 us; error 40 us; skew 500 ppm
21:00:27.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.194208 16975 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:27.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.196518 16975 webserver.cc:534] Webserver started at http://127.16.43.2:44293/ using document root <none> and password file <none>
21:00:27.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.197211 16975 fs_manager.cc:362] Metadata directory not provided
21:00:27.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.197297 16975 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:27.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.197688 16975 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:27.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.200106 16975 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data/instance:
21:00:27.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b63cff18b9874578880169c0328e8285"
21:00:27.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:27 on dist-test-slave-xb7w"
21:00:27.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.200845 16975 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal/instance:
21:00:27.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b63cff18b9874578880169c0328e8285"
21:00:27.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:27 on dist-test-slave-xb7w"
21:00:27.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.206159 16975 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
21:00:27.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.209519 16990 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.210929 16975 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.211076 16975 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b63cff18b9874578880169c0328e8285"
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:27 on dist-test-slave-xb7w"
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.211333 16975 fs_report.cc:389] FS layout report
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data/data
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:27.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:27.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.246351 16975 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:27.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.247347 16975 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:27.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.247627 16975 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:27.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.248569 16975 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
21:00:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.250252 16975 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
21:00:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.250339 16975 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
21:00:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.250419 16975 ts_tablet_manager.cc:616] Registered 0 tablets
21:00:27.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.250469 16975 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
21:00:27.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.287102 16975 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.2:33551
21:00:27.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.287207 17102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.2:33551 every 8 connection(s)
21:00:27.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.288666 16975 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/data/info.pb
21:00:27.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.292543 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 16975
21:00:27.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.292689 16556 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-1/wal/instance
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.296710 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/logs
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data/info.pb
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:27.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.3:0
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.43.3
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.3
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:27.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
21:00:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.315259 17104 heartbeater.cc:344] Connected to a master server at 127.16.43.62:32775
21:00:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.315443 17105 heartbeater.cc:344] Connected to a master server at 127.16.43.61:35389
21:00:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.315713 17105 heartbeater.cc:461] Registering TS with master...
21:00:27.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.315717 17104 heartbeater.cc:461] Registering TS with master...
21:00:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.316968 17105 heartbeater.cc:507] Master 127.16.43.61:35389 requested a full tablet report, sending...
21:00:27.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.316999 17104 heartbeater.cc:507] Master 127.16.43.62:32775 requested a full tablet report, sending...
21:00:27.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.318926 16669 ts_manager.cc:194] Registered new tserver with Master: b63cff18b9874578880169c0328e8285 (127.16.43.2:33551)
21:00:27.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.318933 16597 ts_manager.cc:194] Registered new tserver with Master: b63cff18b9874578880169c0328e8285 (127.16.43.2:33551)
21:00:27.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.320161 16597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.43.2:33503
21:00:27.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.320880 17103 heartbeater.cc:344] Connected to a master server at 127.16.43.60:37825
21:00:27.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.321066 17103 heartbeater.cc:461] Registering TS with master...
21:00:27.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.321529 17103 heartbeater.cc:507] Master 127.16.43.60:37825 requested a full tablet report, sending...
21:00:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.322942 16740 ts_manager.cc:194] Registered new tserver with Master: b63cff18b9874578880169c0328e8285 (127.16.43.2:33551)
21:00:27.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.638140 17109 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:27.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.638487 17109 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:27.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.638603 17109 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:27.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.646744 17109 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:27.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.646965 17109 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.43.3
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.656778 17109 tablet_server_runner.cc:78] Tablet server non-default flags:
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.3:0
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data/info.pb
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.3
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.16.43.3
21:00:27.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/logs
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:27.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:27.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.658867 17109 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:27.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.660688 17109 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:27.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.669554 17116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:27.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.669579 17115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:27.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.670234 17118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:27.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.671554 17109 server_base.cc:1061] running on GCE node
21:00:27.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.672052 17109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:27.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.672855 17109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:27.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.674043 17109 hybrid_clock.cc:648] HybridClock initialized: now 1783544427673997 us; error 42 us; skew 500 ppm
21:00:27.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.674305 17109 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:27.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.676314 17109 webserver.cc:534] Webserver started at http://127.16.43.3:43709/ using document root <none> and password file <none>
21:00:27.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.676951 17109 fs_manager.cc:362] Metadata directory not provided
21:00:27.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.677035 17109 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:27.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.677316 17109 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
21:00:27.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.679616 17109 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data/instance:
21:00:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2791b5558b4f4550a602a44d338d7dd6"
21:00:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:27 on dist-test-slave-xb7w"
21:00:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.680276 17109 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal/instance:
21:00:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2791b5558b4f4550a602a44d338d7dd6"
21:00:27.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:27 on dist-test-slave-xb7w"
21:00:27.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.685585 17109 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
21:00:27.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.688901 17124 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.690239 17109 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.690368 17109 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2791b5558b4f4550a602a44d338d7dd6"
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:27 on dist-test-slave-xb7w"
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.690548 17109 fs_report.cc:389] FS layout report
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data/data
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:27.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:27.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:27.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:27.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:27.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.717892 17109 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:27.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.718856 17109 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:27.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.719132 17109 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:27.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.720148 17109 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
21:00:27.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.722002 17109 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
21:00:27.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.722123 17109 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
21:00:27.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.722222 17109 ts_tablet_manager.cc:616] Registered 0 tablets
21:00:27.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.722298 17109 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
21:00:27.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.757544 17109 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.3:33683
21:00:27.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.757591 17236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.3:33683 every 8 connection(s)
21:00:27.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.759127 17109 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/data/info.pb
21:00:27.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.760028 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 17109
21:00:27.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.760200 16556 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal/instance
21:00:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.776302 17239 heartbeater.cc:344] Connected to a master server at 127.16.43.61:35389
21:00:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.776386 17238 heartbeater.cc:344] Connected to a master server at 127.16.43.62:32775
21:00:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.776757 17238 heartbeater.cc:461] Registering TS with master...
21:00:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.776762 17239 heartbeater.cc:461] Registering TS with master...
21:00:27.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.777802 17239 heartbeater.cc:507] Master 127.16.43.61:35389 requested a full tablet report, sending...
21:00:27.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.777840 17238 heartbeater.cc:507] Master 127.16.43.62:32775 requested a full tablet report, sending...
21:00:27.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.779711 16669 ts_manager.cc:194] Registered new tserver with Master: 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683)
21:00:27.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.779876 16597 ts_manager.cc:194] Registered new tserver with Master: 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683)
21:00:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.780896 16597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.43.3:46331
21:00:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.782153 17237 heartbeater.cc:344] Connected to a master server at 127.16.43.60:37825
21:00:27.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.782336 17237 heartbeater.cc:461] Registering TS with master...
21:00:27.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.782913 17237 heartbeater.cc:507] Master 127.16.43.60:37825 requested a full tablet report, sending...
21:00:27.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.784014 16739 ts_manager.cc:194] Registered new tserver with Master: 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683)
21:00:27.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.788420 16556 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
21:00:27.790 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
21:00:27.790 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

21:00:27.793 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.16.43.62"
      port: 32775
    }
    bound_http_address {
      host: "127.16.43.62"
      port: 41391
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.16.43.61"
      port: 35389
    }
    bound_http_address {
      host: "127.16.43.61"
      port: 33845
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.16.43.60"
      port: 37825
    }
    bound_http_address {
      host: "127.16.43.60"
      port: 46499
    }
  }
}

21:00:27.793 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

21:00:27.795 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.16.43.1"
      port: 34435
    }
    bound_http_address {
      host: "127.16.43.1"
      port: 38555
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.16.43.2"
      port: 33551
    }
    bound_http_address {
      host: "127.16.43.2"
      port: 44293
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.16.43.3"
      port: 33683
    }
    bound_http_address {
      host: "127.16.43.3"
      port: 43709
    }
  }
}

21:00:27.795 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
21:00:27.797 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
21:00:27.799 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.16.43.60:37825(127.16.43.60:37825)] connecting to peer
21:00:27.801 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.16.43.61:35389(127.16.43.61:35389)] connecting to peer
21:00:27.802 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.16.43.60:37825(127.16.43.60:37825)] Successfully connected to peer
21:00:27.802 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.16.43.62:32775(127.16.43.62:32775)] connecting to peer
21:00:27.803 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.16.43.61:35389(127.16.43.61:35389)] Successfully connected to peer
21:00:27.806 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.16.43.62:32775(127.16.43.62:32775)] Successfully connected to peer
21:00:27.806 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.43.61
21:00:27.809 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.43.62
21:00:27.820 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.16.43.60
21:00:27.826 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x17c04cee, L:/127.0.0.1:39762 - R:/127.16.43.61:35389] using SASL/PLAIN
21:00:27.827 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xc38ac794, L:/127.0.0.1:43060 - R:/127.16.43.62:32775] using SASL/PLAIN
21:00:27.830 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
21:00:27.831 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [31ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, deferred=null) after lookup
21:00:27.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.832994 16597 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43060:
21:00:27.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
21:00:27.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:27.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
21:00:27.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
21:00:27.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:27.835022 16597 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
21:00:27.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.849334 16967 heartbeater.cc:499] Master 127.16.43.62:32775 was elected leader, sending a full tablet report...
21:00:27.851 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xef0063e6, L:/127.0.0.1:47012 - R:/127.16.43.60:37825] using SASL/PLAIN
21:00:27.865 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 1ff607393163447f95ec7cb7933ef8e8
21:00:27.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.901686 17038 tablet_service.cc:1511] Processing CreateTablet for tablet ddb2438fd0044ef1bce45cec311016e0 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=1ff607393163447f95ec7cb7933ef8e8]), partition=RANGE (key) PARTITION UNBOUNDED
21:00:27.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.901688 16901 tablet_service.cc:1511] Processing CreateTablet for tablet ddb2438fd0044ef1bce45cec311016e0 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=1ff607393163447f95ec7cb7933ef8e8]), partition=RANGE (key) PARTITION UNBOUNDED
21:00:27.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.902230 17172 tablet_service.cc:1511] Processing CreateTablet for tablet ddb2438fd0044ef1bce45cec311016e0 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=1ff607393163447f95ec7cb7933ef8e8]), partition=RANGE (key) PARTITION UNBOUNDED
21:00:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.903265 17038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb2438fd0044ef1bce45cec311016e0. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.903271 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb2438fd0044ef1bce45cec311016e0. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.903543 17172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddb2438fd0044ef1bce45cec311016e0. 1 dirs total, 0 dirs full, 0 dirs failed
21:00:27.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.915915 17266 tablet_bootstrap.cc:492] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: Bootstrap starting.
21:00:27.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.919809 17267 tablet_bootstrap.cc:492] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: Bootstrap starting.
21:00:27.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.921645 17266 tablet_bootstrap.cc:654] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: Neither blocks nor log segments found. Creating new log.
21:00:27.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.923182 17268 tablet_bootstrap.cc:492] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Bootstrap starting.
21:00:27.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.923622 17267 tablet_bootstrap.cc:654] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: Neither blocks nor log segments found. Creating new log.
21:00:27.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.925051 17267 log.cc:826] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: Log is configured to *not* fsync() on all Append() calls
21:00:27.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.925851 17266 log.cc:826] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: Log is configured to *not* fsync() on all Append() calls
21:00:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.926889 17268 tablet_bootstrap.cc:654] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Neither blocks nor log segments found. Creating new log.
21:00:27.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.928093 17268 log.cc:826] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Log is configured to *not* fsync() on all Append() calls
21:00:27.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.928359 17267 tablet_bootstrap.cc:492] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: No bootstrap required, opened a new log
21:00:27.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.928644 17267 ts_tablet_manager.cc:1403] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
21:00:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.934106 17266 tablet_bootstrap.cc:492] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: No bootstrap required, opened a new log
21:00:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.934095 17268 tablet_bootstrap.cc:492] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: No bootstrap required, opened a new log
21:00:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.934404 17266 ts_tablet_manager.cc:1403] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
21:00:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.934404 17268 ts_tablet_manager.cc:1403] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.006s
21:00:27.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.935640 17267 raft_consensus.cc:359] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.935968 17267 raft_consensus.cc:385] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:27.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.936074 17267 raft_consensus.cc:740] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503038f9153f4530887311fde976e6d1, State: Initialized, Role: FOLLOWER
21:00:27.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.936762 17267 consensus_queue.cc:260] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:27.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.938409 17267 ts_tablet_manager.cc:1434] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
21:00:27.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.941756 17266 raft_consensus.cc:359] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:27.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.942322 17266 raft_consensus.cc:385] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:27.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.942587 17266 raft_consensus.cc:740] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b63cff18b9874578880169c0328e8285, State: Initialized, Role: FOLLOWER
21:00:27.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.943512 17266 consensus_queue.cc:260] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:27.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.948621 17266 ts_tablet_manager.cc:1434] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.004s
21:00:27.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.948985 17104 heartbeater.cc:499] Master 127.16.43.62:32775 was elected leader, sending a full tablet report...
21:00:27.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.947468 17268 raft_consensus.cc:359] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:27.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.949589 17268 raft_consensus.cc:385] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
21:00:27.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.949740 17268 raft_consensus.cc:740] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2791b5558b4f4550a602a44d338d7dd6, State: Initialized, Role: FOLLOWER
21:00:27.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.951587 17268 consensus_queue.cc:260] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:27.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.952845 17238 heartbeater.cc:499] Master 127.16.43.62:32775 was elected leader, sending a full tablet report...
21:00:27.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:27.953289 17268 ts_tablet_manager.cc:1434] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.000s
21:00:28.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.014005 17240 tablet.cc:2406] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:28.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.041643 17106 tablet.cc:2406] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:28.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.062700 16969 tablet.cc:2406] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
21:00:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.077147 17272 raft_consensus.cc:493] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
21:00:28.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.077394 17272 raft_consensus.cc:515] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:28.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.079268 17272 leader_election.cc:290] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b63cff18b9874578880169c0328e8285 (127.16.43.2:33551), 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683)
21:00:28.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.086669 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "503038f9153f4530887311fde976e6d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63cff18b9874578880169c0328e8285" is_pre_election: true
21:00:28.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.086689 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "503038f9153f4530887311fde976e6d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2791b5558b4f4550a602a44d338d7dd6" is_pre_election: true
21:00:28.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.087105 17192 raft_consensus.cc:2468] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503038f9153f4530887311fde976e6d1 in term 0.
21:00:28.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.087143 17058 raft_consensus.cc:2468] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503038f9153f4530887311fde976e6d1 in term 0.
21:00:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.087859 16857 leader_election.cc:304] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2791b5558b4f4550a602a44d338d7dd6, 503038f9153f4530887311fde976e6d1, b63cff18b9874578880169c0328e8285; no voters: 
21:00:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.088229 17272 raft_consensus.cc:2804] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
21:00:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.088409 17272 raft_consensus.cc:493] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
21:00:28.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.088523 17272 raft_consensus.cc:3060] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 0 FOLLOWER]: Advancing to term 1
21:00:28.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.090601 17272 raft_consensus.cc:515] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:28.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.091197 17272 leader_election.cc:290] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [CANDIDATE]: Term 1 election: Requested vote from peers b63cff18b9874578880169c0328e8285 (127.16.43.2:33551), 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683)
21:00:28.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.091747 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "503038f9153f4530887311fde976e6d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b63cff18b9874578880169c0328e8285"
21:00:28.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.091747 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "503038f9153f4530887311fde976e6d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2791b5558b4f4550a602a44d338d7dd6"
21:00:28.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.091950 17058 raft_consensus.cc:3060] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 0 FOLLOWER]: Advancing to term 1
21:00:28.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.091989 17192 raft_consensus.cc:3060] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 0 FOLLOWER]: Advancing to term 1
21:00:28.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.095261 17192 raft_consensus.cc:2468] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503038f9153f4530887311fde976e6d1 in term 1.
21:00:28.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.095261 17058 raft_consensus.cc:2468] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503038f9153f4530887311fde976e6d1 in term 1.
21:00:28.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.095777 16857 leader_election.cc:304] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2791b5558b4f4550a602a44d338d7dd6, 503038f9153f4530887311fde976e6d1, b63cff18b9874578880169c0328e8285; no voters: 
21:00:28.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.096087 17272 raft_consensus.cc:2804] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 1 FOLLOWER]: Leader election won for term 1
21:00:28.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.096623 17272 raft_consensus.cc:697] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [term 1 LEADER]: Becoming Leader. State: Replica: 503038f9153f4530887311fde976e6d1, State: Running, Role: LEADER
21:00:28.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.097281 17272 consensus_queue.cc:237] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.102972 16597 catalog_manager.cc:5696] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503038f9153f4530887311fde976e6d1 (127.16.43.1). New cstate: current_term: 1 leader_uuid: "503038f9153f4530887311fde976e6d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } health_report { overall_health: HEALTHY } } }
21:00:28.324 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 1ff607393163447f95ec7cb7933ef8e8
21:00:28.328 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:28.328 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:28.328 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [3ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: OK, deferred=null) after lookup
21:00:28.329 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:28.331 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] Successfully connected to peer
21:00:28.348 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x9bde86b6, L:/127.0.0.1:45756 - R:/127.16.43.1:34435] using TOKEN/null
21:00:28.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.357664 17192 raft_consensus.cc:1275] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Refusing update from remote peer 503038f9153f4530887311fde976e6d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:28.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.358832 17277 consensus_queue.cc:1048] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:28.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.359056 17058 raft_consensus.cc:1275] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Refusing update from remote peer 503038f9153f4530887311fde976e6d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
21:00:28.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.359978 17272 consensus_queue.cc:1048] T ddb2438fd0044ef1bce45cec311016e0 P 503038f9153f4530887311fde976e6d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
21:00:28.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.381100 17282 mvcc.cc:204] Tried to move back new op lower bound from 7305397978541658112 to 7305397977490923520. Current Snapshot: MvccSnapshot[applied={T|T < 7305397978541658112}]
21:00:28.468 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=ddb2438fd0044ef1bce45cec311016e0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
21:00:28.468 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.16.43.62:32775
21:00:28.469 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

21:00:28.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.469429 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16567
21:00:28.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.470938 16628 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:28.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.600407 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16567
21:00:28.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.621181 16656 connection.cc:573] server connection from 127.0.0.1:39732 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
21:00:28.622 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.16.43.62:32775(127.16.43.62:32775)] handling channelInactive
21:00:28.622 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.16.43.62:32775(127.16.43.62:32775)] cleaning up while in state READY due to: connection closed
21:00:28.623 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
21:00:28.623 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.16.43.62:32775
21:00:28.625 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 0
  }
}

21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.626848 16556 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/logs
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/info.pb
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.62:32775
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.62
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=41391
21:00:28.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:28.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json with env {}
21:00:28.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.977901 17294 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
21:00:28.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.978188 17294 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
21:00:28.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.978269 17294 flags.cc:432] Enabled unsafe flag: --never_fsync=true
21:00:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.986428 17294 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
21:00:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.986513 17294 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
21:00:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.986567 17294 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
21:00:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.986608 17294 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
21:00:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.986656 17294 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
21:00:28.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:28.986689 17294 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:41507/jwks.json
21:00:28.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.996708 17294 master_runner.cc:387] Master server non-default flags:
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.16.43.20:46745
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.16.43.62:32775,127.16.43.61:35389,127.16.43.60:37825
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.16.43.62:32775
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41507/jwks.json
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/info.pb
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.16.43.62
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=41391
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/logs
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
21:00:28.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bec869c2320d19f2589b3f609f76e5041a21d27
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 20:43:55 UTC on bdcb31816ec0
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16877
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
21:00:28.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:28.998301 17294 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
21:00:29.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.000121 17294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
21:00:29.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:29.008080 17299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:29.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:29.008211 17300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:29.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:29.009256 17302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
21:00:29.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.009363 17294 server_base.cc:1061] running on GCE node
21:00:29.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.010154 17294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
21:00:29.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.011641 17294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
21:00:29.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.012831 17294 hybrid_clock.cc:648] HybridClock initialized: now 1783544429012774 us; error 54 us; skew 500 ppm
21:00:29.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.013207 17294 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
21:00:29.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.015352 17294 webserver.cc:534] Webserver started at http://127.16.43.62:41391/ using document root <none> and password file <none>
21:00:29.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.016001 17294 fs_manager.cc:362] Metadata directory not provided
21:00:29.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.016120 17294 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
21:00:29.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.021275 17294 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
21:00:29.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.024080 17308 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
21:00:29.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.025460 17294 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.025663 17294 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data,/tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bc3819effe8f4e0e85479d2675d58272"
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 21:00:24 on dist-test-slave-xb7w"
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.026470 17294 fs_report.cc:389] FS layout report
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/wal
21:00:29.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/data
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
21:00:29.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
21:00:29.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.039642 17294 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
21:00:29.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.040541 17294 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
21:00:29.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.041013 17294 kserver.cc:163] Server-wide thread pool size limit: 3276
21:00:29.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.061430 17294 rpc_server.cc:307] RPC server started. Bound to: 127.16.43.62:32775
21:00:29.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.061450 17359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.43.62:32775 every 8 connection(s)
21:00:29.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.063028 17294 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/master-0/data/info.pb
21:00:29.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.064460 16556 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu as pid 17294
21:00:29.065 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
21:00:29.065 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.16.43.1:34435
21:00:29.066 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

21:00:29.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.066406 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16839
21:00:29.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.071593 17360 sys_catalog.cc:263] Verifying existing consensus state
21:00:29.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.074959 17360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Bootstrap starting.
21:00:29.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.077128 16961 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:29.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.092051 17360 log.cc:826] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Log is configured to *not* fsync() on all Append() calls
21:00:29.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.104539 17360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
21:00:29.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.105228 17360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: Bootstrap complete.
21:00:29.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.113163 17360 raft_consensus.cc:359] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:29.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.113956 17360 raft_consensus.cc:740] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc3819effe8f4e0e85479d2675d58272, State: Initialized, Role: FOLLOWER
21:00:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.114785 17360 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:29.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.115826 17366 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:29.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.116201 17366 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: FOLLOWER
21:00:29.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.117180 17360 sys_catalog.cc:565] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: configured and running, proceeding with master startup.
21:00:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.131592 17377 catalog_manager.cc:1294] Loaded cluster ID: 5fd93db9b2ec4b8aaa6adc6911737c90
21:00:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.132432 17377 catalog_manager.cc:1587] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: loading cluster ID for follower catalog manager: success
21:00:29.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.137176 17377 catalog_manager.cc:1609] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: acquiring CA information for follower catalog manager: success
21:00:29.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.139896 17377 catalog_manager.cc:1637] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
21:00:29.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.168705 17294 master_runner.cc:264] No leader master found from master bc3819effe8f4e0e85479d2675d58272
21:00:29.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.168881 17294 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
21:00:29.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.215310 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16839
21:00:29.245 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] handling channelInactive
21:00:29.245 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state READY due to: connection closed
21:00:29.245 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
21:00:29.246 [DEBUG - Time-limited test] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:29.248 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.248 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.249 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.260 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.16.43.62:32775(127.16.43.62:32775)] connecting to peer
21:00:29.262 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.16.43.62:32775(127.16.43.62:32775)] Successfully connected to peer
21:00:29.292 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0xd27f131b, L:/127.0.0.1:43078 - R:/127.16.43.62:32775] using TOKEN/null
21:00:29.298 [DEBUG - kudu-nio-5] (RemoteTablet.java:166) master-127.16.43.62:32775 was demoted as the leader for Kudu Master
21:00:29.305 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.323 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.343 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.362 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.399742 17325 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b63cff18b9874578880169c0328e8285" instance_seqno: 1783544427277165) as {username='slave'} at 127.16.43.2:45555; Asking this server to re-register.
21:00:29.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.402662 17104 heartbeater.cc:461] Registering TS with master...
21:00:29.405 [WARN - kudu-nio-0] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.407224 17325 ts_manager.cc:194] Registered new tserver with Master: b63cff18b9874578880169c0328e8285 (127.16.43.2:33551)
21:00:29.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.416011 17325 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" instance_seqno: 1783544427749287) as {username='slave'} at 127.16.43.3:46465; Asking this server to re-register.
21:00:29.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.416741 17238 heartbeater.cc:461] Registering TS with master...
21:00:29.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.418112 17325 ts_manager.cc:194] Registered new tserver with Master: 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683)
21:00:29.463 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.583 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775 is a leader; will retry
21:00:29.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.609254 17388 raft_consensus.cc:493] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bc3819effe8f4e0e85479d2675d58272)
21:00:29.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.609519 17388 raft_consensus.cc:515] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:29.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.610927 17388 leader_election.cc:290] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bc3819effe8f4e0e85479d2675d58272 (127.16.43.62:32775), 8f899c782a9245d7b63eb78d1f111da3 (127.16.43.61:35389)
21:00:29.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.612385 16678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "308348fa438b44acbd4f2db48ec3c0fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "8f899c782a9245d7b63eb78d1f111da3" is_pre_election: true
21:00:29.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.618606 17335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "308348fa438b44acbd4f2db48ec3c0fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "bc3819effe8f4e0e85479d2675d58272" is_pre_election: true
21:00:29.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.619189 17335 raft_consensus.cc:2468] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 308348fa438b44acbd4f2db48ec3c0fc in term 1.
21:00:29.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.619843 16724 leader_election.cc:304] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308348fa438b44acbd4f2db48ec3c0fc, bc3819effe8f4e0e85479d2675d58272; no voters: 8f899c782a9245d7b63eb78d1f111da3
21:00:29.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.620324 17388 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Leader pre-election won for term 2
21:00:29.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.620544 17388 raft_consensus.cc:493] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader bc3819effe8f4e0e85479d2675d58272)
21:00:29.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.620718 17388 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 1 FOLLOWER]: Advancing to term 2
21:00:29.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.623077 17388 raft_consensus.cc:515] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.623898 17388 leader_election.cc:290] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [CANDIDATE]: Term 2 election: Requested vote from peers bc3819effe8f4e0e85479d2675d58272 (127.16.43.62:32775), 8f899c782a9245d7b63eb78d1f111da3 (127.16.43.61:35389)
21:00:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.624363 17335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "308348fa438b44acbd4f2db48ec3c0fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "bc3819effe8f4e0e85479d2675d58272"
21:00:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.624539 17335 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 1 FOLLOWER]: Advancing to term 2
21:00:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.624487 16678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "308348fa438b44acbd4f2db48ec3c0fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "8f899c782a9245d7b63eb78d1f111da3"
21:00:29.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.628387 17335 raft_consensus.cc:2468] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308348fa438b44acbd4f2db48ec3c0fc in term 2.
21:00:29.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.628806 16724 leader_election.cc:304] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308348fa438b44acbd4f2db48ec3c0fc, bc3819effe8f4e0e85479d2675d58272; no voters: 8f899c782a9245d7b63eb78d1f111da3
21:00:29.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.629144 17388 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 2 FOLLOWER]: Leader election won for term 2
21:00:29.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.629658 17388 raft_consensus.cc:697] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [term 2 LEADER]: Becoming Leader. State: Replica: 308348fa438b44acbd4f2db48ec3c0fc, State: Running, Role: LEADER
21:00:29.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.630183 17388 consensus_queue.cc:237] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } }
21:00:29.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.632262 17390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 308348fa438b44acbd4f2db48ec3c0fc. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:29.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.632627 17390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: This master's current role is: LEADER
21:00:29.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.633308 17392 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
21:00:29.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.635824 17392 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=1ff607393163447f95ec7cb7933ef8e8]
21:00:29.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.637444 17392 tablet_loader.cc:96] loaded metadata for tablet ddb2438fd0044ef1bce45cec311016e0 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=1ff607393163447f95ec7cb7933ef8e8])
21:00:29.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.637693 17392 catalog_manager.cc:1519] Initializing Kudu cluster ID...
21:00:29.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.638487 17392 catalog_manager.cc:1294] Loaded cluster ID: 5fd93db9b2ec4b8aaa6adc6911737c90
21:00:29.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.638562 17392 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
21:00:29.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.639810 17392 catalog_manager.cc:1539] Loading token signing keys...
21:00:29.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.640683 17392 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: Loaded TSK: 0
21:00:29.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:29.641544 17392 catalog_manager.cc:1549] Initializing in-progress tserver states...
21:00:29.764 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
21:00:29.766 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=9, TimeoutTracker(timeout=29987, elapsed=505), Traces: [0ms] sending RPC to server master-127.16.43.62:32775, [39ms] delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [39ms] received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [43ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [46ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [63ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [64ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [83ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [85ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [103ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [104ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [141ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [144ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [144ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [147ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [200ms] refreshing cache from master, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [203ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [203ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [204ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [204ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [320ms] refreshing cache from master, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [323ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [324ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [324ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [324ms] delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [500ms] refreshing cache from master, [500ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [504ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [505ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [505ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, deferred=Deferred@1257405014(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC -> (continuation of Deferred@198078682 after retry RPC after error@2071082454) -> (continuation of Deferred@1940152817 after retry RPC after error@719160601) -> (continuation of Deferred@1382901816 after retry RPC after error@945498918) -> (continuation of Deferred@1755344437 after retry RPC after error@781441909) -> (continuation of Deferred@386288183 after retry RPC after error@1994740202) -> (continuation of Deferred@492787909 after retry RPC after error@757559400) -> (continuation of Deferred@139837449 after retry RPC after error@1424210664), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@198078682 after retry RPC after error@2071082454) -> (continuation of Deferred@1940152817 after retry RPC after error@719160601) -> (continuation of Deferred@1382901816 after retry RPC after error@945498918) -> (continuation of Deferred@1755344437 after retry RPC after error@781441909) -> (continuation of Deferred@386288183 after retry RPC after error@1994740202) -> (continuation of Deferred@492787909 after retry RPC after error@757559400) -> (continuation of Deferred@139837449 after retry RPC after error@1424210664))) after lookup
21:00:29.770 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:29.770 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:29.772 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=525), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test)) after lookup
21:00:29.772 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:29.775 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.775 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.775 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.782 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:29.782 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:29.783 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=537), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [526ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [529ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [529ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [533ms] refreshing cache from master, [533ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [536ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429))) after lookup
21:00:29.784 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:29.786 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.786 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.786 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.822 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:29.823 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:29.824 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=577), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [526ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [529ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [529ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [533ms] refreshing cache from master, [533ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [536ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [538ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [540ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [540ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [573ms] refreshing cache from master, [573ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [576ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934))) after lookup
21:00:29.825 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:29.826 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.826 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.826 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.882 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:29.883 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:29.884 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=637), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [526ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [529ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [529ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [533ms] refreshing cache from master, [533ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [536ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [538ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [540ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [540ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [573ms] refreshing cache from master, [573ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [576ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [578ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [580ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [580ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [633ms] refreshing cache from master, [633ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [636ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628))) after lookup
21:00:29.885 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:29.886 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.886 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.886 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:29.983 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:29.984 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=737), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [526ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [529ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [529ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [533ms] refreshing cache from master, [533ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [536ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [538ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [540ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [540ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [573ms] refreshing cache from master, [573ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [576ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [578ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [580ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [580ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [633ms] refreshing cache from master, [633ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [636ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [639ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [640ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [640ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [733ms] refreshing cache from master, [733ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [736ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628) -> (continuation of Deferred@716826701 after retry RPC@335217507), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628) -> (continuation of Deferred@716826701 after retry RPC@335217507))) after lookup
21:00:29.985 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:29.986 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.986 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:29.986 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:30.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.017251 17335 raft_consensus.cc:1275] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [term 2 FOLLOWER]: Refusing update from remote peer 308348fa438b44acbd4f2db48ec3c0fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
21:00:30.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.018188 17390 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
21:00:30.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.020700 17395 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 308348fa438b44acbd4f2db48ec3c0fc. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:30.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.020979 17395 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: FOLLOWER
21:00:30.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.022756 17390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:30.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.023022 17390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: This master's current role is: LEADER
21:00:30.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.023603 16678 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 1 FOLLOWER]: Advancing to term 2
21:00:30.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.023674 17395 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:30.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.023842 17395 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc3819effe8f4e0e85479d2675d58272 [sys.catalog]: This master's current role is: FOLLOWER
21:00:30.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.026180 16678 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [term 2 FOLLOWER]: Refusing update from remote peer 308348fa438b44acbd4f2db48ec3c0fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
21:00:30.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.027117 17390 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
21:00:30.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.029816 17403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:30.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.029899 17400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 308348fa438b44acbd4f2db48ec3c0fc. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:30.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.030102 17403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: This master's current role is: FOLLOWER
21:00:30.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.030150 17400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f899c782a9245d7b63eb78d1f111da3 [sys.catalog]: This master's current role is: FOLLOWER
21:00:30.383 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:30.383 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435)[L],b63cff18b9874578880169c0328e8285(127.16.43.2:33551)]}]
21:00:30.384 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1137), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [526ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [529ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [529ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [533ms] refreshing cache from master, [533ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [536ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [538ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [540ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [540ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [573ms] refreshing cache from master, [573ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [576ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [578ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [580ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [580ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [633ms] refreshing cache from master, [633ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [636ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [639ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [640ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [640ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [733ms] refreshing cache from master, [733ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [736ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [738ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [740ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [740ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [1133ms] refreshing cache from master, [1133ms] too many traces: truncated at 100 traces, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628) -> (continuation of Deferred@716826701 after retry RPC@335217507) -> (continuation of Deferred@366629325 after retry RPC@1592895502), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628) -> (continuation of Deferred@716826701 after retry RPC@335217507) -> (continuation of Deferred@366629325 after retry RPC@1592895502))) after lookup
21:00:30.385 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] connecting to peer
21:00:30.386 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:30.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] cleaning up while in state CONNECTING due to: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:30.386 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 503038f9153f4530887311fde976e6d1(127.16.43.1:34435) for tablet ddb2438fd0044ef1bce45cec311016e0: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435
21:00:30.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.457062 17404 raft_consensus.cc:493] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503038f9153f4530887311fde976e6d1)
21:00:30.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.457253 17404 raft_consensus.cc:515] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:30.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.458802 17404 leader_election.cc:290] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b63cff18b9874578880169c0328e8285 (127.16.43.2:33551), 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435)
21:00:30.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:30.460506 17125 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:30.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:30.461871 17125 leader_election.cc:336] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435): Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:30.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.465490 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "2791b5558b4f4550a602a44d338d7dd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "b63cff18b9874578880169c0328e8285" is_pre_election: true
21:00:30.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.466114 17125 leader_election.cc:304] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2791b5558b4f4550a602a44d338d7dd6; no voters: 503038f9153f4530887311fde976e6d1, b63cff18b9874578880169c0328e8285
21:00:30.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.466454 17404 raft_consensus.cc:2749] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
21:00:30.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.541271 17409 raft_consensus.cc:493] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 503038f9153f4530887311fde976e6d1)
21:00:30.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.541523 17409 raft_consensus.cc:515] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:30.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.543097 17409 leader_election.cc:290] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683), 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435)
21:00:30.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:30.544345 16991 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:30.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:30.545955 16991 leader_election.cc:336] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435): Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:30.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.549715 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "b63cff18b9874578880169c0328e8285" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "2791b5558b4f4550a602a44d338d7dd6" is_pre_election: true
21:00:30.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.549957 17192 raft_consensus.cc:2468] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b63cff18b9874578880169c0328e8285 in term 1.
21:00:30.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.550443 16994 leader_election.cc:304] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2791b5558b4f4550a602a44d338d7dd6, b63cff18b9874578880169c0328e8285; no voters: 503038f9153f4530887311fde976e6d1
21:00:30.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.550797 17409 raft_consensus.cc:2804] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Leader pre-election won for term 2
21:00:30.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.550925 17409 raft_consensus.cc:493] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 503038f9153f4530887311fde976e6d1)
21:00:30.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.551081 17409 raft_consensus.cc:3060] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 1 FOLLOWER]: Advancing to term 2
21:00:30.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.553079 17409 raft_consensus.cc:515] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:30.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.553721 17409 leader_election.cc:290] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [CANDIDATE]: Term 2 election: Requested vote from peers 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683), 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435)
21:00:30.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.554338 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddb2438fd0044ef1bce45cec311016e0" candidate_uuid: "b63cff18b9874578880169c0328e8285" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "2791b5558b4f4550a602a44d338d7dd6"
21:00:30.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.554566 17192 raft_consensus.cc:3060] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 1 FOLLOWER]: Advancing to term 2
21:00:30.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:30.555217 16991 leader_election.cc:336] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435): Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:30.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.556967 17192 raft_consensus.cc:2468] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b63cff18b9874578880169c0328e8285 in term 2.
21:00:30.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.557366 16994 leader_election.cc:304] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2791b5558b4f4550a602a44d338d7dd6, b63cff18b9874578880169c0328e8285; no voters: 503038f9153f4530887311fde976e6d1
21:00:30.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.557716 17409 raft_consensus.cc:2804] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 2 FOLLOWER]: Leader election won for term 2
21:00:30.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.558120 17409 raft_consensus.cc:697] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [term 2 LEADER]: Becoming Leader. State: Replica: b63cff18b9874578880169c0328e8285, State: Running, Role: LEADER
21:00:30.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.558465 17103 heartbeater.cc:499] Master 127.16.43.60:37825 was elected leader, sending a full tablet report...
21:00:30.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.558693 17409 consensus_queue.cc:237] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } }
21:00:30.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.563293 16739 catalog_manager.cc:5696] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 reported cstate change: term changed from 1 to 2, leader changed from 503038f9153f4530887311fde976e6d1 (127.16.43.1) to b63cff18b9874578880169c0328e8285 (127.16.43.2). New cstate: current_term: 2 leader_uuid: "b63cff18b9874578880169c0328e8285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b63cff18b9874578880169c0328e8285" member_type: VOTER last_known_addr { host: "127.16.43.2" port: 33551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "503038f9153f4530887311fde976e6d1" member_type: VOTER last_known_addr { host: "127.16.43.1" port: 34435 } health_report { overall_health: UNKNOWN } } }
21:00:30.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.567231 17390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "308348fa438b44acbd4f2db48ec3c0fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } }
21:00:30.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.567448 17390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc [sys.catalog]: This master's current role is: LEADER
21:00:30.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.975766 17192 raft_consensus.cc:1275] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 2 FOLLOWER]: Refusing update from remote peer b63cff18b9874578880169c0328e8285: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
21:00:30.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.976487 17409 consensus_queue.cc:1048] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2791b5558b4f4550a602a44d338d7dd6" member_type: VOTER last_known_addr { host: "127.16.43.3" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
21:00:30.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:30.978052 17237 heartbeater.cc:499] Master 127.16.43.60:37825 was elected leader, sending a full tablet report...
21:00:30.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:30.983914 16991 consensus_peers.cc:597] T ddb2438fd0044ef1bce45cec311016e0 P b63cff18b9874578880169c0328e8285 -> Peer 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435): Couldn't send request to peer 503038f9153f4530887311fde976e6d1. Status: Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
21:00:31.683 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet ddb2438fd0044ef1bce45cec311016e0 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
21:00:31.684 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=ddb2438fd0044ef1bce45cec311016e0@[2791b5558b4f4550a602a44d338d7dd6(127.16.43.3:33683),503038f9153f4530887311fde976e6d1(127.16.43.1:34435),b63cff18b9874578880169c0328e8285(127.16.43.2:33551)[L]]}]
21:00:31.684 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=ddb2438fd0044ef1bce45cec311016e0, attempt=14, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2438), Traces: [0ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [2ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [3ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.62:32775, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [52ms] Sub RPC GetTableLocations: received response from server master-127.16.43.62:32775: Illegal state: Not the leader. Local UUID: bc3819effe8f4e0e85479d2675d58272, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc3819effe8f4e0e85479d2675d58272" member_type: VOTER last_known_addr { host: "127.16.43.62" port: 32775 } } peers { permanent_uuid: "8f899c782a9245d7b63eb78d1f111da3" member_type: VOTER last_known_addr { host: "127.16.43.61" port: 35389 } } peers { permanent_uuid: "308348fa438b44acbd4f2db48ec3c0fc" member_type: VOTER last_known_addr { host: "127.16.43.60" port: 37825 } } } (error 0), [53ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [56ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [59ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [59ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [96ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [116ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [154ms] Sub RPC GetTableLocations: refreshing cache from master, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [159ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [160ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [213ms] Sub RPC GetTableLocations: refreshing cache from master, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [214ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [333ms] Sub RPC GetTableLocations: refreshing cache from master, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [334ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [336ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [337ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [337ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.16.43.60:37825,127.16.43.61:35389,127.16.43.62:32775) has no leader., [513ms] Sub RPC GetTableLocations: refreshing cache from master, [513ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.60:37825, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.61:35389, [514ms] Sub RPC ConnectToMaster: sending RPC to server master-127.16.43.62:32775, [517ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.62:32775: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.60:37825: OK, [518ms] Sub RPC ConnectToMaster: received response from server master-127.16.43.61:35389: OK, [520ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [524ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [526ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [529ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [529ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [533ms] refreshing cache from master, [533ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [536ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [538ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [540ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [540ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [573ms] refreshing cache from master, [573ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [576ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [578ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [580ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [580ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [633ms] refreshing cache from master, [633ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [636ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [639ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [640ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [640ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [733ms] refreshing cache from master, [733ms] Sub RPC GetTableLocations: sending RPC to server master-127.16.43.60:37825, [736ms] Sub RPC GetTableLocations: received response from server master-127.16.43.60:37825: OK, [738ms] sending RPC to server 503038f9153f4530887311fde976e6d1, [740ms] received response from server 503038f9153f4530887311fde976e6d1: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [740ms] delaying RPC due to: Network error: Failed to connect to peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435): Connection refused: /127.16.43.1:34435, [1133ms] refreshing cache from master, [1133ms] too many traces: truncated at 100 traces, deferred=Deferred@623889402(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007fbb8836de18@35c02de -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628) -> (continuation of Deferred@716826701 after retry RPC@335217507) -> (continuation of Deferred@366629325 after retry RPC@1592895502) -> (continuation of Deferred@291414981 after retry RPC@1119672376), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a21dca7 -> wakeup thread Time-limited test -> (continuation of Deferred@1257405014 after retry RPC@1873394429) -> (continuation of Deferred@715271502 after retry RPC@254952934) -> (continuation of Deferred@50408809 after retry RPC@1053877628) -> (continuation of Deferred@716826701 after retry RPC@335217507) -> (continuation of Deferred@366629325 after retry RPC@1592895502) -> (continuation of Deferred@291414981 after retry RPC@1119672376))) after lookup
21:00:31.685 [DEBUG - kudu-nio-0] (Connection.java:748) [peer b63cff18b9874578880169c0328e8285(127.16.43.2:33551)] connecting to peer
21:00:31.686 [DEBUG - kudu-nio-4] (Connection.java:757) [peer b63cff18b9874578880169c0328e8285(127.16.43.2:33551)] Successfully connected to peer
21:00:31.709 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x6ed1f64a, L:/127.0.0.1:39120 - R:/127.16.43.2:33551] using TOKEN/null
21:00:31.789 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=ddb2438fd0044ef1bce45cec311016e0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
21:00:31.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.791204 16740 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47012:
21:00:31.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
21:00:31.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.791564 16740 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47012:
21:00:31.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
21:00:31.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.812630 16740 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc: Sending DeleteTablet for 3 replicas of tablet ddb2438fd0044ef1bce45cec311016e0
21:00:31.823 [DEBUG - main] (Connection.java:575) [peer b63cff18b9874578880169c0328e8285(127.16.43.2:33551)] disconnecting while in state READY
21:00:31.823 [DEBUG - main] (Connection.java:575) [peer 503038f9153f4530887311fde976e6d1(127.16.43.1:34435)] disconnecting while in state TERMINATED
21:00:31.823 [DEBUG - main] (Connection.java:575) [peer master-127.16.43.62:32775(127.16.43.62:32775)] disconnecting while in state READY
21:00:31.823 [DEBUG - main] (Connection.java:575) [peer master-127.16.43.61:35389(127.16.43.61:35389)] disconnecting while in state READY
21:00:31.823 [DEBUG - main] (Connection.java:575) [peer master-127.16.43.60:37825(127.16.43.60:37825)] disconnecting while in state READY
21:00:31.824 [DEBUG - kudu-nio-4] (Connection.java:239) [peer b63cff18b9874578880169c0328e8285(127.16.43.2:33551)] handling channelInactive
21:00:31.824 [DEBUG - kudu-nio-4] (Connection.java:709) [peer b63cff18b9874578880169c0328e8285(127.16.43.2:33551)] cleaning up while in state READY due to: connection closed
21:00:31.825 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.16.43.62:32775(127.16.43.62:32775)] handling channelInactive
21:00:31.825 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.16.43.62:32775(127.16.43.62:32775)] cleaning up while in state READY due to: connection closed
21:00:31.826 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.16.43.61:35389(127.16.43.61:35389)] handling channelInactive
21:00:31.826 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.16.43.61:35389(127.16.43.61:35389)] cleaning up while in state READY due to: connection closed
21:00:31.829 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
21:00:31.829 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.16.43.60:37825(127.16.43.60:37825)] handling channelInactive
21:00:31.829 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.16.43.60:37825(127.16.43.60:37825)] cleaning up while in state READY due to: connection closed
21:00:31.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.831825 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16975
21:00:31.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.834301 17172 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb2438fd0044ef1bce45cec311016e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 21:00:31 UTC) from {username='slave'} at 127.0.0.1:35832
21:00:31.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.835414 17458 tablet_replica.cc:333] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: stopping tablet replica
21:00:31.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.836086 17458 raft_consensus.cc:2243] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 2 FOLLOWER]: Raft consensus shutting down.
21:00:31.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.836930 17458 raft_consensus.cc:2272] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6 [term 2 FOLLOWER]: Raft consensus is shut down!
21:00:31.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.839098 17458 ts_tablet_manager.cc:1916] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Deleting tablet data with delete state TABLET_DATA_DELETED
21:00:31.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.848500 17458 ts_tablet_manager.cc:1929] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
21:00:31.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.849054 17458 log.cc:1199] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Deleting WAL directory at /tmp/dist-test-taskOoRw2s/test-tmp/mini-kudu-cluster15228834940816380879/ts-2/wal/wals/ddb2438fd0044ef1bce45cec311016e0
21:00:31.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.849956 17458 ts_tablet_manager.cc:1950] T ddb2438fd0044ef1bce45cec311016e0 P 2791b5558b4f4550a602a44d338d7dd6: Deleting consensus metadata
21:00:31.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.852633 16727 catalog_manager.cc:5027] TS 2791b5558b4f4550a602a44d338d7dd6 (127.16.43.3:33683): tablet ddb2438fd0044ef1bce45cec311016e0 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=1ff607393163447f95ec7cb7933ef8e8]) successfully deleted
21:00:31.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.857323 17038 tablet_service.cc:1558] Processing DeleteTablet for tablet ddb2438fd0044ef1bce45cec311016e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 21:00:31 UTC) from {username='slave'} at 127.0.0.1:39124
21:00:31.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:31.858075 16724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:31.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.858310 17098 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:31.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:31.861545 16724 catalog_manager.cc:4754] TS 503038f9153f4530887311fde976e6d1 (127.16.43.1:34435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ddb2438fd0044ef1bce45cec311016e0: Network error: Client connection negotiation failed: client connection to 127.16.43.1:34435: connect: Connection refused (error 111)
21:00:31.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.966673 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16975
21:00:31.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.986027 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 17109
21:00:31.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:31.993140 17232 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:32.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.086778 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 17109
21:00:32.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.104939 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 17294
21:00:32.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.111958 17355 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:32.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.217235 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 17294
21:00:32.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.237921 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16637
21:00:32.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:32.237920 16724 connection.cc:573] client connection to 127.16.43.62:32775 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
21:00:32.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.239060 16699 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:32.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 21:00:32.239274 16724 consensus_peers.cc:597] T 00000000000000000000000000000000 P 308348fa438b44acbd4f2db48ec3c0fc -> Peer bc3819effe8f4e0e85479d2675d58272 (127.16.43.62:32775): Couldn't send request to peer bc3819effe8f4e0e85479d2675d58272. Status: Network error: Client connection negotiation failed: client connection to 127.16.43.62:32775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
21:00:32.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.348591 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16637
21:00:32.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.368486 16556 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu pid 16706
21:00:32.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.369568 16770 generic_service.cc:196] Checking for leaks (request via RPC)
21:00:32.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 21:00:32.481992 16556 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOoRw2s/build/asan/bin/kudu with pid 16706
21:00:32.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T21:00:32Z chronyd exiting

Time: 16.868

OK (2 tests)

