JUnit version 4.13.2
.05:51:48.796 [INFO - main] (RandomUtils.java:49) Using random seed: 1783489908791
05:51:48.839 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
05:51:48.895 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
05:51:48.909 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskAojDjo/test-tmp
05:51:48.911 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
05:51:48.914 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskAojDjo/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
05:51:49.161 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

05:51:49.315 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:51:49.316 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

05:51:49.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.319027 21324 mini_oidc.cc:152] Starting JWKS server
05:51:49.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.321992 21324 webserver.cc:460] Webserver started at http://127.0.0.1:34909/ using document root <none> and password file <none>
05:51:49.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.322297 21324 mini_oidc.cc:189] Starting OIDC Discovery server
05:51:49.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.323035 21324 webserver.cc:460] Webserver started at http://127.0.0.1:40947/ using document root <none> and password file <none>
05:51:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:51:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
05:51:49.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:51:49Z Disabled control of system clock
05:51:49.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.350868 21324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:49.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:49.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal
05:51:49.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data
05:51:49.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:49.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:49.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:49.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:49.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:49.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:49.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/logs
05:51:49.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data/info.pb
05:51:49.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:49.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:49.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.62:38361
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.62
05:51:49.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:49.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34909/jwks.json with env {}
05:51:49.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.668263 21335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.668533 21335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.668644 21335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.675806 21335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:51:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.675915 21335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.675956 21335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:51:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.676005 21335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:51:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.676062 21335 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:51:49.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.676124 21335 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:34909/jwks.json
05:51:49.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.690582 21335 master_runner.cc:386] Master server non-default flags:
05:51:49.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:49.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:49.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:49.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:49.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data
05:51:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal
05:51:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:49.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.62:38361
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34909/jwks.json
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data/info.pb
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.62
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:49.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/logs
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:49.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.692340 21335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:49.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.694802 21335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:49.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.707667 21341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:49.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.707762 21343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:49.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.707746 21340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:49.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.708591 21335 server_base.cc:1034] running on GCE node
05:51:49.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.709412 21335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:49.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.710774 21335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:49.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.712006 21335 hybrid_clock.cc:648] HybridClock initialized: now 1783489909711927 us; error 48 us; skew 500 ppm
05:51:49.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.712430 21335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:49.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.714671 21335 webserver.cc:460] Webserver started at http://127.20.211.62:38909/ using document root <none> and password file <none>
05:51:49.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.715382 21335 fs_manager.cc:359] Metadata directory not provided
05:51:49.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.715559 21335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:49.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.715926 21335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:49.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.718551 21335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data/instance:
05:51:49.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b52a0bf0ba1d443b90f132011a81148b"
05:51:49.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:49 on dist-test-slave-fnnq"
05:51:49.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.719444 21335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal/instance:
05:51:49.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b52a0bf0ba1d443b90f132011a81148b"
05:51:49.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:49 on dist-test-slave-fnnq"
05:51:49.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.724700 21335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
05:51:49.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.728044 21349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:49.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.729478 21335 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
05:51:49.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.729718 21335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal
05:51:49.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b52a0bf0ba1d443b90f132011a81148b"
05:51:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:49 on dist-test-slave-fnnq"
05:51:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.729962 21335 fs_report.cc:383] FS layout report
05:51:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal
05:51:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal
05:51:49.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data/data
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:49.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:49.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:49.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.757409 21335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:49.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.758356 21335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:49.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.758725 21335 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:49.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.777088 21335 rpc_server.cc:307] RPC server started. Bound to: 127.20.211.62:38361
05:51:49.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.777110 21400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.211.62:38361 every 8 connection(s)
05:51:49.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.778641 21335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/data/info.pb
05:51:49.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.782546 21401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:49.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.786660 21324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 21335
05:51:49.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.786932 21324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-0/wal/instance
05:51:49.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.789717 21324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/logs
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data/info.pb
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.61:38971
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.61
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:49.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:49.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:49.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:49.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:49.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:49.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34909/jwks.json with env {}
05:51:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.789958 21401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
05:51:49.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.808084 21401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } has no permanent_uuid. Determining permanent_uuid...
05:51:49.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.809242 21350 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.211.61:38971: connect: Connection refused (error 111)
05:51:49.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.810739 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.61:38971: Network error: Client connection negotiation failed: client connection to 127.20.211.61:38971: connect: Connection refused (error 111)
05:51:49.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.860082 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } attempt: 1
05:51:49.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.862185 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.61:38971: Network error: Client connection negotiation failed: client connection to 127.20.211.61:38971: connect: Connection refused (error 111)
05:51:49.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:49.930464 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } attempt: 2
05:51:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:49.932603 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.61:38971: Network error: Client connection negotiation failed: client connection to 127.20.211.61:38971: connect: Connection refused (error 111)
05:51:50.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.023873 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } attempt: 3
05:51:50.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.026057 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.61:38971: Network error: Client connection negotiation failed: client connection to 127.20.211.61:38971: connect: Connection refused (error 111)
05:51:50.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.107790 21403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:50.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.108111 21403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:50.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.108233 21403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:50.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.115433 21403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:51:50.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.115588 21403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:50.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.115658 21403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:51:50.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.115725 21403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:51:50.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.115778 21403 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:51:50.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.115854 21403 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:34909/jwks.json
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.124771 21403 master_runner.cc:386] Master server non-default flags:
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:50.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.61:38971
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34909/jwks.json
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data/info.pb
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.61
05:51:50.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/logs
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:51:50.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:50.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:50.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:50.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:50.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:50.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:50.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.126470 21403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:50.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.128861 21403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:50.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.140827 21412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:50.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.140740 21411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:50.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.141387 21414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:50.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.141651 21403 server_base.cc:1034] running on GCE node
05:51:50.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.142334 21403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:50.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.143636 21403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:50.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.144868 21403 hybrid_clock.cc:648] HybridClock initialized: now 1783489910144786 us; error 49 us; skew 500 ppm
05:51:50.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.145251 21403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:50.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.147478 21403 webserver.cc:460] Webserver started at http://127.20.211.61:33415/ using document root <none> and password file <none>
05:51:50.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.148205 21403 fs_manager.cc:359] Metadata directory not provided
05:51:50.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.148339 21403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:50.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.148711 21403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:50.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.151265 21403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data/instance:
05:51:50.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9"
05:51:50.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:50 on dist-test-slave-fnnq"
05:51:50.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.152237 21403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal/instance:
05:51:50.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9"
05:51:50.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:50 on dist-test-slave-fnnq"
05:51:50.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.157473 21403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
05:51:50.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.161203 21420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:50.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.162493 21403 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
05:51:50.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.162674 21403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9"
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:50 on dist-test-slave-fnnq"
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.162937 21403 fs_report.cc:383] FS layout report
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data/data
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:50.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:50.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:50.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.169292 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } attempt: 4
05:51:50.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.171098 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.61:38971: Network error: Client connection negotiation failed: client connection to 127.20.211.61:38971: connect: Connection refused (error 111)
05:51:50.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.204277 21403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:50.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.205233 21403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:50.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.205615 21403 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:50.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.224347 21403 rpc_server.cc:307] RPC server started. Bound to: 127.20.211.61:38971
05:51:50.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.224380 21471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.211.61:38971 every 8 connection(s)
05:51:50.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.225829 21403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/data/info.pb
05:51:50.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.229599 21472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:50.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.235716 21324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 21403
05:51:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.235908 21324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-1/wal/instance
05:51:50.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.235769 21472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.237067 21324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:50.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/logs
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data/info.pb
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:50.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:51:50.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:50.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:50.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:50.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.60:40403
05:51:50.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.60
05:51:50.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:50.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34909/jwks.json with env {}
05:51:50.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.251380 21472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.261901 21472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.263018 21423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.264642 21472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.314052 21472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 1
05:51:50.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.316090 21472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.384368 21472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 2
05:51:50.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.386544 21472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.470355 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } attempt: 5
05:51:50.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.477780 21472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 3
05:51:50.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.479969 21472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.480753 21401 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.482609 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.533854 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 1
05:51:50.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.536158 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.570542 21475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:50.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.570828 21475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:50.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.570912 21475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.578120 21475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:51:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.578226 21475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.578270 21475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:51:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.578318 21475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:51:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.578356 21475 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:51:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.578408 21475 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:34909/jwks.json
05:51:50.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.587626 21475 master_runner.cc:386] Master server non-default flags:
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.60:40403
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:50.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34909/jwks.json
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data/info.pb
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.60
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/logs
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:50.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.589011 21475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:50.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.591246 21475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:50.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.604389 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 2
05:51:50.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.605983 21483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:50.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.605937 21485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:50.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.606757 21475 server_base.cc:1034] running on GCE node
05:51:50.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.606809 21401 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.607049 21482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:50.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.608062 21475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:50.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.609582 21475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:50.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.610838 21475 hybrid_clock.cc:648] HybridClock initialized: now 1783489910610767 us; error 41 us; skew 500 ppm
05:51:50.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.611234 21475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:50.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.613622 21475 webserver.cc:460] Webserver started at http://127.20.211.60:37635/ using document root <none> and password file <none>
05:51:50.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.614320 21475 fs_manager.cc:359] Metadata directory not provided
05:51:50.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.614461 21475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:50.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.614809 21475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:50.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.617461 21475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data/instance:
05:51:50.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "601c9f50121645bebbc53d2d67c8ae92"
05:51:50.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:50 on dist-test-slave-fnnq"
05:51:50.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.618448 21475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal/instance:
05:51:50.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "601c9f50121645bebbc53d2d67c8ae92"
05:51:50.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:50 on dist-test-slave-fnnq"
05:51:50.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.623203 21472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 4
05:51:50.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.623463 21475 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
05:51:50.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.625010 21472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:50.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.627164 21491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:50.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.628561 21475 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:51:50.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.628708 21475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal
05:51:50.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "601c9f50121645bebbc53d2d67c8ae92"
05:51:50.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:50 on dist-test-slave-fnnq"
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.628856 21475 fs_report.cc:383] FS layout report
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data/data
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:50.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:50.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.667990 21475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:50.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.668879 21475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:50.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.669153 21475 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:50.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.688099 21475 rpc_server.cc:307] RPC server started. Bound to: 127.20.211.60:40403
05:51:50.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.688144 21542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.211.60:40403 every 8 connection(s)
05:51:50.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.689330 21475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/data/info.pb
05:51:50.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.693200 21543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:50.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.693924 21324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 21475
05:51:50.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.694036 21324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/master-2/wal/instance
05:51:50.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.700981 21543 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.713009 21401 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 3
05:51:50.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.716303 21543 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.730590 21543 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
05:51:50.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.730654 21401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: Bootstrap starting.
05:51:50.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.734328 21401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: Neither blocks nor log segments found. Creating new log.
05:51:50.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.735965 21401 log.cc:824] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: Log is configured to *not* fsync() on all Append() calls
05:51:50.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.739143 21401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: No bootstrap required, opened a new log
05:51:50.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.741096 21543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: Bootstrap starting.
05:51:50.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.744005 21543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: Neither blocks nor log segments found. Creating new log.
05:51:50.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.745038 21543 log.cc:824] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: Log is configured to *not* fsync() on all Append() calls
05:51:50.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.747345 21401 raft_consensus.cc:348] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.747694 21401 raft_consensus.cc:374] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:50.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.747781 21401 raft_consensus.cc:729] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52a0bf0ba1d443b90f132011a81148b, State: Initialized, Role: FOLLOWER
05:51:50.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.748260 21543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: No bootstrap required, opened a new log
05:51:50.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.748396 21401 consensus_queue.cc:260] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.749344 21553 sys_catalog.cc:455] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:50.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.751977 21553 sys_catalog.cc:458] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: This master's current role is: FOLLOWER
05:51:50.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.750608 21401 sys_catalog.cc:564] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: configured and running, proceeding with master startup.
05:51:50.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.758358 21543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.758706 21543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:50.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.758814 21543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 601c9f50121645bebbc53d2d67c8ae92, State: Initialized, Role: FOLLOWER
05:51:50.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.759416 21543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.760740 21562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:50.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.761349 21562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: This master's current role is: FOLLOWER
05:51:50.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.761325 21355 tablet.cc:2369] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:51:50.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.762816 21543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: configured and running, proceeding with master startup.
05:51:50.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.773718 21565 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:51:50.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.774313 21565 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:51:50.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.768424 21335 master_runner.cc:186] Error getting master registration for 127.20.211.61:38971: OK, instance_id { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" instance_seqno: 1783489910219054 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:51:50.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.795672 21335 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:51:50.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.784370 21475 master_runner.cc:186] Error getting master registration for 127.20.211.61:38971: OK, instance_id { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" instance_seqno: 1783489910219054 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:51:50.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.796371 21475 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:51:50.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.798728 21577 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:51:50.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.799072 21577 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:51:50.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:50.921171 21497 tablet.cc:2369] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:51:50.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.924247 21472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } attempt: 5
05:51:50.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.937846 21472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: Bootstrap starting.
05:51:50.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.941890 21472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: Neither blocks nor log segments found. Creating new log.
05:51:50.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.943572 21472 log.cc:824] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: Log is configured to *not* fsync() on all Append() calls
05:51:50.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.948205 21472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: No bootstrap required, opened a new log
05:51:50.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.959208 21472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.959645 21472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.959761 21472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffd6e984cee4b69b88a86d7a6a6d2b9, State: Initialized, Role: FOLLOWER
05:51:50.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.960523 21472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.961573 21580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:50.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.962180 21580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: This master's current role is: FOLLOWER
05:51:50.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.962862 21472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: configured and running, proceeding with master startup.
05:51:50.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.974341 21562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:51:50.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.974697 21562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.976353 21562 leader_election.cc:288] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52a0bf0ba1d443b90f132011a81148b (127.20.211.62:38361), 1ffd6e984cee4b69b88a86d7a6a6d2b9 (127.20.211.61:38971)
05:51:50.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.978048 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "601c9f50121645bebbc53d2d67c8ae92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52a0bf0ba1d443b90f132011a81148b" is_pre_election: true
05:51:50.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.978672 21376 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 601c9f50121645bebbc53d2d67c8ae92 in term 0.
05:51:50.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.979346 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "601c9f50121645bebbc53d2d67c8ae92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" is_pre_election: true
05:51:50.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.979921 21447 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 601c9f50121645bebbc53d2d67c8ae92 in term 0.
05:51:50.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.980983 21492 leader_election.cc:302] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffd6e984cee4b69b88a86d7a6a6d2b9, 601c9f50121645bebbc53d2d67c8ae92; no voters: 
05:51:50.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.982067 21562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Leader pre-election won for term 1
05:51:50.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.982214 21562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:51:50.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.982307 21562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 0 FOLLOWER]: Advancing to term 1
05:51:50.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.986680 21562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:50.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.989607 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "601c9f50121645bebbc53d2d67c8ae92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52a0bf0ba1d443b90f132011a81148b"
05:51:50.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.989823 21376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 0 FOLLOWER]: Advancing to term 1
05:51:50.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:50.992942 21376 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 601c9f50121645bebbc53d2d67c8ae92 in term 1.
05:51:51.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.002007 21403 master_runner.cc:263] No leader master found from master 1ffd6e984cee4b69b88a86d7a6a6d2b9
05:51:51.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.002184 21591 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:51:51.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.002322 21591 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:51:51.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.006341 21403 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:51:51.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.007905 21493 leader_election.cc:302] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 601c9f50121645bebbc53d2d67c8ae92, b52a0bf0ba1d443b90f132011a81148b; no voters: 
05:51:51.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.014428 21593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 1 FOLLOWER]: Leader election won for term 1
05:51:51.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.016571 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "601c9f50121645bebbc53d2d67c8ae92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9"
05:51:51.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.016829 21447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 0 FOLLOWER]: Advancing to term 1
05:51:51.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.020879 21447 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 601c9f50121645bebbc53d2d67c8ae92 in term 1.
05:51:51.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.022847 21562 leader_election.cc:288] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [CANDIDATE]: Term 1 election: Requested vote from peers b52a0bf0ba1d443b90f132011a81148b (127.20.211.62:38361), 1ffd6e984cee4b69b88a86d7a6a6d2b9 (127.20.211.61:38971)
05:51:51.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.025986 21593 raft_consensus.cc:686] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [term 1 LEADER]: Becoming Leader. State: Replica: 601c9f50121645bebbc53d2d67c8ae92, State: Running, Role: LEADER
05:51:51.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.027007 21593 consensus_queue.cc:237] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:51.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.040107 21562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 601c9f50121645bebbc53d2d67c8ae92. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.040423 21562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: This master's current role is: LEADER
05:51:51.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.044142 21596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:51:51.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.046675 21596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:51:51.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.068487 21447 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Refusing update from remote peer 601c9f50121645bebbc53d2d67c8ae92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:51:51.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.069476 21562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:51:51.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.069825 21376 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 1 FOLLOWER]: Refusing update from remote peer 601c9f50121645bebbc53d2d67c8ae92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:51:51.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.070686 21562 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:51:51.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.115399 21597 mvcc.cc:205] Tried to move back new op lower bound from 7305174675726442496 to 7305174675577057280. Current Snapshot: MvccSnapshot[applied={T|T < 7305174675726442496}]
05:51:51.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.116673 21580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 601c9f50121645bebbc53d2d67c8ae92. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.116997 21580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: This master's current role is: FOLLOWER
05:51:51.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.118706 21598 mvcc.cc:205] Tried to move back new op lower bound from 7305174675726442496 to 7305174675577057280. Current Snapshot: MvccSnapshot[applied={T|T < 7305174675726442496}]
05:51:51.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.124046 21580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.124297 21580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: This master's current role is: FOLLOWER
05:51:51.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.128734 21553 sys_catalog.cc:455] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 601c9f50121645bebbc53d2d67c8ae92. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.129034 21553 sys_catalog.cc:458] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: This master's current role is: FOLLOWER
05:51:51.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.133147 21593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.133484 21593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: This master's current role is: LEADER
05:51:51.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.140607 21593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.140923 21593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92 [sys.catalog]: This master's current role is: LEADER
05:51:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.142127 21596 catalog_manager.cc:1347] Generated new cluster ID: f5906fa7d92d4e1195b6ff41f1f497bb
05:51:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.142237 21596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:51:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.148054 21553 sys_catalog.cc:455] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "601c9f50121645bebbc53d2d67c8ae92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.148319 21553 sys_catalog.cc:458] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: This master's current role is: FOLLOWER
05:51:51.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.172559 21596 catalog_manager.cc:1370] Generated new certificate authority record
05:51:51.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.174847 21596 catalog_manager.cc:1504] Loading token signing keys...
05:51:51.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.206804 21596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 601c9f50121645bebbc53d2d67c8ae92: Generated new TSK 0
05:51:51.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.208518 21596 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:51:51.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.226740 21324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:51.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:51.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal
05:51:51.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/logs
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data/info.pb
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.1:0
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.211.1
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.1
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:51.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:51.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:51.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:51.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:51.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:51:51.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.612074 21605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:51.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.612344 21605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:51.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.612422 21605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:51.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.619539 21605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:51.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.619702 21605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.211.1
05:51:51.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.628567 21605 tablet_server_runner.cc:78] Tablet server non-default flags:
05:51:51.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.1:0
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data/info.pb
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.1
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.211.1
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/logs
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:51.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.629858 21605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:51.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.631646 21605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:51.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.646433 21610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.646499 21611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:51.646576 21613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:51.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.647574 21605 server_base.cc:1034] running on GCE node
05:51:51.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.648350 21605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:51.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.649576 21605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:51.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.650832 21605 hybrid_clock.cc:648] HybridClock initialized: now 1783489911650740 us; error 57 us; skew 500 ppm
05:51:51.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.651211 21605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:51.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.653571 21605 webserver.cc:460] Webserver started at http://127.20.211.1:42247/ using document root <none> and password file <none>
05:51:51.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.654289 21605 fs_manager.cc:359] Metadata directory not provided
05:51:51.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.654431 21605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:51.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.654758 21605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.657717 21605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data/instance:
05:51:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "de3300ec121e431482920270ac8f99a9"
05:51:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:51 on dist-test-slave-fnnq"
05:51:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.658545 21605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal/instance:
05:51:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "de3300ec121e431482920270ac8f99a9"
05:51:51.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:51 on dist-test-slave-fnnq"
05:51:51.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.663658 21605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
05:51:51.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.667447 21619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.668927 21605 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.669070 21605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "de3300ec121e431482920270ac8f99a9"
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:51 on dist-test-slave-fnnq"
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.669239 21605 fs_report.cc:383] FS layout report
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data/data
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:51.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:51.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.683205 21605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:51.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.684090 21605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:51.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.684418 21605 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:51.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.685714 21605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:51:51.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.687922 21605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:51:51.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.688015 21605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:51:51.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.688126 21605 ts_tablet_manager.cc:610] Registered 0 tablets
05:51:51.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.688174 21605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:51:51.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.722266 21605 rpc_server.cc:307] RPC server started. Bound to: 127.20.211.1:38627
05:51:51.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.722302 21731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.211.1:38627 every 8 connection(s)
05:51:51.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.723658 21605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/data/info.pb
05:51:51.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.730079 21324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 21605
05:51:51.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.730324 21324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-0/wal/instance
05:51:51.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.752230 21324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:51.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:51.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/logs
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data/info.pb
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:51:51.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.2:0
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.211.2
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.2
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:51.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:51:51.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.760083 21733 heartbeater.cc:347] Connected to a master server at 127.20.211.60:40403
05:51:51.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.760370 21733 heartbeater.cc:464] Registering TS with master...
05:51:51.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.761278 21733 heartbeater.cc:511] Master 127.20.211.60:40403 requested a full tablet report, sending...
05:51:51.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.762068 21734 heartbeater.cc:347] Connected to a master server at 127.20.211.61:38971
05:51:51.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.762156 21732 heartbeater.cc:347] Connected to a master server at 127.20.211.62:38361
05:51:51.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.762270 21734 heartbeater.cc:464] Registering TS with master...
05:51:51.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.762313 21732 heartbeater.cc:464] Registering TS with master...
05:51:51.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.762794 21734 heartbeater.cc:511] Master 127.20.211.61:38971 requested a full tablet report, sending...
05:51:51.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.762811 21732 heartbeater.cc:511] Master 127.20.211.62:38361 requested a full tablet report, sending...
05:51:51.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.764566 21366 ts_manager.cc:194] Registered new tserver with Master: de3300ec121e431482920270ac8f99a9 (127.20.211.1:38627)
05:51:51.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.764632 21437 ts_manager.cc:194] Registered new tserver with Master: de3300ec121e431482920270ac8f99a9 (127.20.211.1:38627)
05:51:51.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.766449 21508 ts_manager.cc:194] Registered new tserver with Master: de3300ec121e431482920270ac8f99a9 (127.20.211.1:38627)
05:51:51.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.768838 21508 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.211.1:50997
05:51:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.776387 21565 catalog_manager.cc:1259] Loaded cluster ID: f5906fa7d92d4e1195b6ff41f1f497bb
05:51:51.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.776499 21565 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: loading cluster ID for follower catalog manager: success
05:51:51.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.779034 21565 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: acquiring CA information for follower catalog manager: success
05:51:51.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:51.780838 21565 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:51:52.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.004739 21591 catalog_manager.cc:1259] Loaded cluster ID: f5906fa7d92d4e1195b6ff41f1f497bb
05:51:52.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.004851 21591 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: loading cluster ID for follower catalog manager: success
05:51:52.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.008811 21591 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: acquiring CA information for follower catalog manager: success
05:51:52.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.011495 21591 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:51:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.091495 21742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:52.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.091785 21742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:52.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.091926 21742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.099040 21742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.099202 21742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.211.2
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.108143 21742 tablet_server_runner.cc:78] Tablet server non-default flags:
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.2:0
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data/info.pb
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.2
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:52.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.211.2
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/logs
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:52.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.109375 21742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:52.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.111101 21742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.124023 21750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.124163 21748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.124198 21747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.127637 21742 server_base.cc:1034] running on GCE node
05:51:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.128281 21742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:52.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.129274 21742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.130519 21742 hybrid_clock.cc:648] HybridClock initialized: now 1783489912130446 us; error 52 us; skew 500 ppm
05:51:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.130862 21742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:52.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.133415 21742 webserver.cc:460] Webserver started at http://127.20.211.2:40619/ using document root <none> and password file <none>
05:51:52.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.134326 21742 fs_manager.cc:359] Metadata directory not provided
05:51:52.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.134473 21742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:52.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.134821 21742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:52.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.137728 21742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data/instance:
05:51:52.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b4d11e4461124100977b1c29c49a88f1"
05:51:52.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:52 on dist-test-slave-fnnq"
05:51:52.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.138433 21742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal/instance:
05:51:52.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b4d11e4461124100977b1c29c49a88f1"
05:51:52.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:52 on dist-test-slave-fnnq"
05:51:52.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.143850 21742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.004s
05:51:52.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.147433 21756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.148895 21742 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.149032 21742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b4d11e4461124100977b1c29c49a88f1"
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:52 on dist-test-slave-fnnq"
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.149284 21742 fs_report.cc:383] FS layout report
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data/data
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:52.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:52.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.181632 21742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:52.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.182435 21742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:52.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.182690 21742 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:52.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.183620 21742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:51:52.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.185060 21742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:51:52.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.185137 21742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:51:52.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.185217 21742 ts_tablet_manager.cc:610] Registered 0 tablets
05:51:52.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.185253 21742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:51:52.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.218241 21742 rpc_server.cc:307] RPC server started. Bound to: 127.20.211.2:37643
05:51:52.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.218321 21868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.211.2:37643 every 8 connection(s)
05:51:52.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.219552 21742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/data/info.pb
05:51:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.224756 21324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 21742
05:51:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.224922 21324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-1/wal/instance
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.233902 21324 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:52.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/logs
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data/info.pb
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.3:0
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.211.3
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.3
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:52.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:52.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:52.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:52.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:52.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:51:52.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.255573 21871 heartbeater.cc:347] Connected to a master server at 127.20.211.61:38971
05:51:52.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.255879 21871 heartbeater.cc:464] Registering TS with master...
05:51:52.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.256487 21870 heartbeater.cc:347] Connected to a master server at 127.20.211.60:40403
05:51:52.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.256605 21870 heartbeater.cc:464] Registering TS with master...
05:51:52.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.256840 21871 heartbeater.cc:511] Master 127.20.211.61:38971 requested a full tablet report, sending...
05:51:52.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.257021 21870 heartbeater.cc:511] Master 127.20.211.60:40403 requested a full tablet report, sending...
05:51:52.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.255436 21869 heartbeater.cc:347] Connected to a master server at 127.20.211.62:38361
05:51:52.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.258119 21869 heartbeater.cc:464] Registering TS with master...
05:51:52.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.258330 21508 ts_manager.cc:194] Registered new tserver with Master: b4d11e4461124100977b1c29c49a88f1 (127.20.211.2:37643)
05:51:52.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.258505 21869 heartbeater.cc:511] Master 127.20.211.62:38361 requested a full tablet report, sending...
05:51:52.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.258490 21437 ts_manager.cc:194] Registered new tserver with Master: b4d11e4461124100977b1c29c49a88f1 (127.20.211.2:37643)
05:51:52.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.259408 21508 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.211.2:35759
05:51:52.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.259936 21366 ts_manager.cc:194] Registered new tserver with Master: b4d11e4461124100977b1c29c49a88f1 (127.20.211.2:37643)
05:51:52.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.579793 21876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:52.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.580060 21876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:52.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.580137 21876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:52.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.587177 21876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:52.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.587347 21876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.211.3
05:51:52.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.596496 21876 tablet_server_runner.cc:78] Tablet server non-default flags:
05:51:52.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:52.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.211.20:46303
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.211.3:0
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data/info.pb
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.211.3
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.211.3
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/logs
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:52.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:52.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.597811 21876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:52.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.599925 21876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.613435 21881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.613550 21882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:52.613572 21884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:52.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.614283 21876 server_base.cc:1034] running on GCE node
05:51:52.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.614980 21876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:52.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.616039 21876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:52.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.617303 21876 hybrid_clock.cc:648] HybridClock initialized: now 1783489912617228 us; error 41 us; skew 500 ppm
05:51:52.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.617641 21876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:52.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.620155 21876 webserver.cc:460] Webserver started at http://127.20.211.3:39585/ using document root <none> and password file <none>
05:51:52.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.620932 21876 fs_manager.cc:359] Metadata directory not provided
05:51:52.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.621089 21876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:52.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.621426 21876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:52.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.624330 21876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data/instance:
05:51:52.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1fe201f5b5344e380679c5a36af8fc7"
05:51:52.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:52 on dist-test-slave-fnnq"
05:51:52.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.625200 21876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal/instance:
05:51:52.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1fe201f5b5344e380679c5a36af8fc7"
05:51:52.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:52 on dist-test-slave-fnnq"
05:51:52.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.630661 21876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
05:51:52.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.634253 21890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:52.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.635780 21876 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.635964 21876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d1fe201f5b5344e380679c5a36af8fc7"
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:52 on dist-test-slave-fnnq"
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.636204 21876 fs_report.cc:383] FS layout report
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data/data
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:52.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:52.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:52.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:52.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:52.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:52.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:52.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.661557 21876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:52.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.662472 21876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:52.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.662846 21876 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:52.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.664112 21876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:51:52.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.665932 21876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:51:52.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.666054 21876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:51:52.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.666188 21876 ts_tablet_manager.cc:610] Registered 0 tablets
05:51:52.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.666278 21876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:51:52.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.704530 21876 rpc_server.cc:307] RPC server started. Bound to: 127.20.211.3:43367
05:51:52.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.704617 22002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.211.3:43367 every 8 connection(s)
05:51:52.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.705868 21876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/data/info.pb
05:51:52.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.711753 21324 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 21876
05:51:52.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.711957 21324 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8854974055195056048/ts-2/wal/instance
05:51:52.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.727243 22005 heartbeater.cc:347] Connected to a master server at 127.20.211.61:38971
05:51:52.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.727563 22005 heartbeater.cc:464] Registering TS with master...
05:51:52.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.728526 22005 heartbeater.cc:511] Master 127.20.211.61:38971 requested a full tablet report, sending...
05:51:52.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.729879 22003 heartbeater.cc:347] Connected to a master server at 127.20.211.62:38361
05:51:52.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.730015 22003 heartbeater.cc:464] Registering TS with master...
05:51:52.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.730494 22003 heartbeater.cc:511] Master 127.20.211.62:38361 requested a full tablet report, sending...
05:51:52.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.730942 21437 ts_manager.cc:194] Registered new tserver with Master: d1fe201f5b5344e380679c5a36af8fc7 (127.20.211.3:43367)
05:51:52.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.731724 21366 ts_manager.cc:194] Registered new tserver with Master: d1fe201f5b5344e380679c5a36af8fc7 (127.20.211.3:43367)
05:51:52.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.731776 22004 heartbeater.cc:347] Connected to a master server at 127.20.211.60:40403
05:51:52.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.731909 22004 heartbeater.cc:464] Registering TS with master...
05:51:52.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.732295 22004 heartbeater.cc:511] Master 127.20.211.60:40403 requested a full tablet report, sending...
05:51:52.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.733183 21508 ts_manager.cc:194] Registered new tserver with Master: d1fe201f5b5344e380679c5a36af8fc7 (127.20.211.3:43367)
05:51:52.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.734292 21508 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.211.3:40339
05:51:52.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.737557 21324 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
05:51:52.739 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:51:52.740 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

05:51:52.751 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.20.211.62"
      port: 38361
    }
    bound_http_address {
      host: "127.20.211.62"
      port: 38909
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.20.211.61"
      port: 38971
    }
    bound_http_address {
      host: "127.20.211.61"
      port: 33415
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.20.211.60"
      port: 40403
    }
    bound_http_address {
      host: "127.20.211.60"
      port: 37635
    }
  }
}

05:51:52.756 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

05:51:52.759 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.20.211.1"
      port: 38627
    }
    bound_http_address {
      host: "127.20.211.1"
      port: 42247
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.20.211.2"
      port: 37643
    }
    bound_http_address {
      host: "127.20.211.2"
      port: 40619
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.20.211.3"
      port: 43367
    }
    bound_http_address {
      host: "127.20.211.3"
      port: 39585
    }
  }
}

05:51:52.760 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
05:51:52.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:52.771575 21733 heartbeater.cc:503] Master 127.20.211.60:40403 was elected leader, sending a full tablet report...
05:51:52.936 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:51:53.052 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:51:53.125 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.20.211.62:38361(127.20.211.62:38361)] connecting to peer
05:51:53.181 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.20.211.61:38971(127.20.211.61:38971)] connecting to peer
05:51:53.184 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:53.222 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.211.61:38971(127.20.211.61:38971)] Successfully connected to peer
05:51:53.224 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.211.62:38361(127.20.211.62:38361)] Successfully connected to peer
05:51:53.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.261732 21870 heartbeater.cc:503] Master 127.20.211.60:40403 was elected leader, sending a full tablet report...
05:51:53.311 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.211.60:40403(127.20.211.60:40403)] Successfully connected to peer
05:51:53.337 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.211.62
05:51:53.337 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.211.61
05:51:53.523 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.20.211.60
05:51:53.549 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x56227386, L:/127.0.0.1:45760 - R:/127.20.211.61:38971] using SASL/PLAIN
05:51:53.553 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcca48b84, L:/127.0.0.1:59402 - R:/127.20.211.62:38361] using SASL/PLAIN
05:51:53.567 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9a4580b1, L:/127.0.0.1:53178 - R:/127.20.211.60:40403] using SASL/PLAIN
05:51:53.612 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:51:53.614 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=528), Traces: [0ms] refreshing cache from master, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [475ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [475ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [485ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: OK, deferred=null) after lookup
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.671154 21508 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53178:
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=OPEN_TABLE"
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:51:53.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
05:51:53.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:51:53.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:53.673524 21508 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=OPEN_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
05:51:53.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.735664 21938 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0163610fa344de9a791ef347c4f4cc (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=a1382aba88ea4734b89fe3275374779f]), partition=RANGE (key) PARTITION UNBOUNDED
05:51:53.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.736610 22004 heartbeater.cc:503] Master 127.20.211.60:40403 was elected leader, sending a full tablet report...
05:51:53.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.738432 21938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0163610fa344de9a791ef347c4f4cc. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:53.741 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table a1382aba88ea4734b89fe3275374779f
05:51:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.741616 21804 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0163610fa344de9a791ef347c4f4cc (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=a1382aba88ea4734b89fe3275374779f]), partition=RANGE (key) PARTITION UNBOUNDED
05:51:53.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.743757 21804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0163610fa344de9a791ef347c4f4cc. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:53.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.760664 22031 tablet_bootstrap.cc:492] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: Bootstrap starting.
05:51:53.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.762248 22032 tablet_bootstrap.cc:492] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: Bootstrap starting.
05:51:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.764917 22031 tablet_bootstrap.cc:654] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: Neither blocks nor log segments found. Creating new log.
05:51:53.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.766114 22031 log.cc:824] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: Log is configured to *not* fsync() on all Append() calls
05:51:53.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.767091 22032 tablet_bootstrap.cc:654] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: Neither blocks nor log segments found. Creating new log.
05:51:53.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.769552 22031 tablet_bootstrap.cc:492] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: No bootstrap required, opened a new log
05:51:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.769985 22031 ts_tablet_manager.cc:1397] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
05:51:53.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.770360 22032 log.cc:824] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: Log is configured to *not* fsync() on all Append() calls
05:51:53.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.773494 21667 tablet_service.cc:1467] Processing CreateTablet for tablet 1e0163610fa344de9a791ef347c4f4cc (DEFAULT_TABLE table=TestMasterFailover-killBefore=OPEN_TABLE [id=a1382aba88ea4734b89fe3275374779f]), partition=RANGE (key) PARTITION UNBOUNDED
05:51:53.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.775208 21667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e0163610fa344de9a791ef347c4f4cc. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:53.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.778931 22031 raft_consensus.cc:348] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:53.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.779315 22031 raft_consensus.cc:374] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:53.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.779575 22031 raft_consensus.cc:729] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1fe201f5b5344e380679c5a36af8fc7, State: Initialized, Role: FOLLOWER
05:51:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.780505 22031 consensus_queue.cc:260] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.782061 22032 tablet_bootstrap.cc:492] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: No bootstrap required, opened a new log
05:51:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.782617 22032 ts_tablet_manager.cc:1397] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
05:51:53.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.791574 22031 ts_tablet_manager.cc:1428] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.005s
05:51:53.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.795446 22032 raft_consensus.cc:348] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:53.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.796113 22032 raft_consensus.cc:374] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:53.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.796716 22032 raft_consensus.cc:729] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4d11e4461124100977b1c29c49a88f1, State: Initialized, Role: FOLLOWER
05:51:53.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.797539 22032 consensus_queue.cc:260] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:53.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.798924 22036 tablet_bootstrap.cc:492] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: Bootstrap starting.
05:51:53.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.801048 22032 ts_tablet_manager.cc:1428] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.003s
05:51:53.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.803077 22036 tablet_bootstrap.cc:654] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: Neither blocks nor log segments found. Creating new log.
05:51:53.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.804574 22036 log.cc:824] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: Log is configured to *not* fsync() on all Append() calls
05:51:53.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.806905 22036 tablet_bootstrap.cc:492] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: No bootstrap required, opened a new log
05:51:53.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.807204 22036 ts_tablet_manager.cc:1397] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: Time spent bootstrapping tablet: real 0.009s	user 0.006s	sys 0.000s
05:51:53.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.814999 22036 raft_consensus.cc:348] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:53.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.815375 22036 raft_consensus.cc:374] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:53.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.815474 22036 raft_consensus.cc:729] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de3300ec121e431482920270ac8f99a9, State: Initialized, Role: FOLLOWER
05:51:53.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.816062 22036 consensus_queue.cc:260] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:53.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:53.817698 22036 ts_tablet_manager.cc:1428] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.007s
05:51:53.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:53.960273 22006 tablet.cc:2369] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:51:53.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:53.974202 21872 tablet.cc:2369] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:51:53.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:53.994043 21735 tablet.cc:2369] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:51:54.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.174896 22037 raft_consensus.cc:482] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:51:54.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.175211 22037 raft_consensus.cc:504] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:54.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.176963 22037 leader_election.cc:288] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1fe201f5b5344e380679c5a36af8fc7 (127.20.211.3:43367), de3300ec121e431482920270ac8f99a9 (127.20.211.1:38627)
05:51:54.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.183864 21958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0163610fa344de9a791ef347c4f4cc" candidate_uuid: "b4d11e4461124100977b1c29c49a88f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1fe201f5b5344e380679c5a36af8fc7" is_pre_election: true
05:51:54.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.184156 21687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0163610fa344de9a791ef347c4f4cc" candidate_uuid: "b4d11e4461124100977b1c29c49a88f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de3300ec121e431482920270ac8f99a9" is_pre_election: true
05:51:54.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.184414 21958 raft_consensus.cc:2454] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4d11e4461124100977b1c29c49a88f1 in term 0.
05:51:54.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.184557 21687 raft_consensus.cc:2454] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4d11e4461124100977b1c29c49a88f1 in term 0.
05:51:54.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.185135 21757 leader_election.cc:302] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d11e4461124100977b1c29c49a88f1, de3300ec121e431482920270ac8f99a9; no voters: 
05:51:54.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.185508 22037 raft_consensus.cc:2781] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
05:51:54.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.185688 22037 raft_consensus.cc:482] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:51:54.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.185791 22037 raft_consensus.cc:3037] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 0 FOLLOWER]: Advancing to term 1
05:51:54.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.188072 22037 raft_consensus.cc:504] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:54.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.188709 22037 leader_election.cc:288] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [CANDIDATE]: Term 1 election: Requested vote from peers d1fe201f5b5344e380679c5a36af8fc7 (127.20.211.3:43367), de3300ec121e431482920270ac8f99a9 (127.20.211.1:38627)
05:51:54.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.189198 21958 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0163610fa344de9a791ef347c4f4cc" candidate_uuid: "b4d11e4461124100977b1c29c49a88f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1fe201f5b5344e380679c5a36af8fc7"
05:51:54.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.189240 21687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e0163610fa344de9a791ef347c4f4cc" candidate_uuid: "b4d11e4461124100977b1c29c49a88f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de3300ec121e431482920270ac8f99a9"
05:51:54.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.189396 21687 raft_consensus.cc:3037] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [term 0 FOLLOWER]: Advancing to term 1
05:51:54.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.189405 21958 raft_consensus.cc:3037] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [term 0 FOLLOWER]: Advancing to term 1
05:51:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.191370 21687 raft_consensus.cc:2454] T 1e0163610fa344de9a791ef347c4f4cc P de3300ec121e431482920270ac8f99a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4d11e4461124100977b1c29c49a88f1 in term 1.
05:51:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.191433 21958 raft_consensus.cc:2454] T 1e0163610fa344de9a791ef347c4f4cc P d1fe201f5b5344e380679c5a36af8fc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4d11e4461124100977b1c29c49a88f1 in term 1.
05:51:54.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.191785 21757 leader_election.cc:302] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4d11e4461124100977b1c29c49a88f1, de3300ec121e431482920270ac8f99a9; no voters: 
05:51:54.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.192037 22037 raft_consensus.cc:2781] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 1 FOLLOWER]: Leader election won for term 1
05:51:54.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.192510 22037 raft_consensus.cc:686] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [term 1 LEADER]: Becoming Leader. State: Replica: b4d11e4461124100977b1c29c49a88f1, State: Running, Role: LEADER
05:51:54.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.193010 22037 consensus_queue.cc:237] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } }
05:51:54.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.198236 21508 catalog_manager.cc:5495] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4d11e4461124100977b1c29c49a88f1 (127.20.211.2). New cstate: current_term: 1 leader_uuid: "b4d11e4461124100977b1c29c49a88f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4d11e4461124100977b1c29c49a88f1" member_type: VOTER last_known_addr { host: "127.20.211.2" port: 37643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 } health_report { overall_health: UNKNOWN } } }
05:51:54.231 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.20.211.60:40403
05:51:54.233 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

05:51:54.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.233623 21324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 21475
05:51:54.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.235285 21538 generic_service.cc:196] Checking for leaks (request via RPC)
05:51:54.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.353132 21324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 21475
05:51:54.374 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
05:51:54.379 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.211.60:40403(127.20.211.60:40403)] handling channelInactive
05:51:54.380 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state READY due to: connection closed
05:51:54.380 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location master-127.20.211.60:40403(127.20.211.60:40403) for tablet Kudu Master: connection closed
05:51:54.388 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.392 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.392 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.392 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.395 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.407 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.412 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.412 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.413 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.413 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.427 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.431 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.431 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.431 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.431 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.448 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.451 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.451 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.452 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.452 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.468 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.472 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.472 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.473 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.474 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.487 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.492 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.493 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.493 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.587 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.591 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.591 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.591 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.592 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.609836 22037 consensus_queue.cc:1035] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de3300ec121e431482920270ac8f99a9" member_type: VOTER last_known_addr { host: "127.20.211.1" port: 38627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:51:54.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:54.616546 21733 heartbeater.cc:644] Failed to heartbeat to 127.20.211.60:40403 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:54.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:54.619024 21870 heartbeater.cc:644] Failed to heartbeat to 127.20.211.60:40403 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:54.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:54.619786 22037 consensus_queue.cc:1035] T 1e0163610fa344de9a791ef347c4f4cc P b4d11e4461124100977b1c29c49a88f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1fe201f5b5344e380679c5a36af8fc7" member_type: VOTER last_known_addr { host: "127.20.211.3" port: 43367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:51:54.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:54.626082 22004 heartbeater.cc:644] Failed to heartbeat to 127.20.211.60:40403 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:54.627 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.632 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.632 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.632 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:54.727 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:54.729 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.729 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.730 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:54.732 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:55.468 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:55.480 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:55.480 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:55.480 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:55.480 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403; will retry
05:51:55.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.704411 22060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 601c9f50121645bebbc53d2d67c8ae92)
05:51:55.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.704665 22060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:55.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.706048 22060 leader_election.cc:288] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52a0bf0ba1d443b90f132011a81148b (127.20.211.62:38361), 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403)
05:51:55.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.707028 22061 raft_consensus.cc:482] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 601c9f50121645bebbc53d2d67c8ae92)
05:51:55.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:55.707157 21423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111) [suppressed 4 similar messages]
05:51:55.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.707340 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b52a0bf0ba1d443b90f132011a81148b" is_pre_election: true
05:51:55.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.707476 22061 raft_consensus.cc:504] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:55.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.708122 21376 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffd6e984cee4b69b88a86d7a6a6d2b9 in term 1.
05:51:55.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.709079 21422 leader_election.cc:302] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffd6e984cee4b69b88a86d7a6a6d2b9, b52a0bf0ba1d443b90f132011a81148b; no voters: 
05:51:55.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.709519 22060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
05:51:55.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.709627 22060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 601c9f50121645bebbc53d2d67c8ae92)
05:51:55.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.709720 22060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 1 FOLLOWER]: Advancing to term 2
05:51:55.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.710407 22061 leader_election.cc:288] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ffd6e984cee4b69b88a86d7a6a6d2b9 (127.20.211.61:38971), 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403)
05:51:55.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:55.710724 21352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111) [suppressed 7 similar messages]
05:51:55.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.713274 22060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:55.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.714120 22060 leader_election.cc:288] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [CANDIDATE]: Term 2 election: Requested vote from peers b52a0bf0ba1d443b90f132011a81148b (127.20.211.62:38361), 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403)
05:51:55.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.714660 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b52a0bf0ba1d443b90f132011a81148b"
05:51:55.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.714920 21376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 1 FOLLOWER]: Advancing to term 2
05:51:55.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:55.715924 21423 leader_election.cc:334] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403): Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:55.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.715862 21447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b52a0bf0ba1d443b90f132011a81148b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" is_pre_election: true
05:51:55.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.716192 21447 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52a0bf0ba1d443b90f132011a81148b in current term 2: Already voted for candidate 1ffd6e984cee4b69b88a86d7a6a6d2b9 in this term.
05:51:55.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:55.717043 21423 leader_election.cc:334] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403): Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:55.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:55.717088 21352 leader_election.cc:334] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403): Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111)
05:51:55.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.717304 21352 leader_election.cc:302] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52a0bf0ba1d443b90f132011a81148b; no voters: 1ffd6e984cee4b69b88a86d7a6a6d2b9, 601c9f50121645bebbc53d2d67c8ae92
05:51:55.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.717855 21376 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffd6e984cee4b69b88a86d7a6a6d2b9 in term 2.
05:51:55.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.718055 22061 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
05:51:55.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.718242 21422 leader_election.cc:302] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffd6e984cee4b69b88a86d7a6a6d2b9, b52a0bf0ba1d443b90f132011a81148b; no voters: 601c9f50121645bebbc53d2d67c8ae92
05:51:55.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.718528 22060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 2 FOLLOWER]: Leader election won for term 2
05:51:55.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.718953 22060 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [term 2 LEADER]: Becoming Leader. State: Replica: 1ffd6e984cee4b69b88a86d7a6a6d2b9, State: Running, Role: LEADER
05:51:55.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.719334 22060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } }
05:51:55.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.721222 22067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ffd6e984cee4b69b88a86d7a6a6d2b9. Latest consensus state: current_term: 2 leader_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:55.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.721763 22067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: This master's current role is: LEADER
05:51:55.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.722544 22069 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:51:55.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.724773 22069 catalog_manager.cc:669] Loaded metadata for table TestMasterFailover-killBefore=OPEN_TABLE [id=a1382aba88ea4734b89fe3275374779f]
05:51:55.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.726300 22069 tablet_loader.cc:96] loaded metadata for tablet 1e0163610fa344de9a791ef347c4f4cc (table TestMasterFailover-killBefore=OPEN_TABLE [id=a1382aba88ea4734b89fe3275374779f])
05:51:55.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.726533 22069 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:51:55.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.727480 22069 catalog_manager.cc:1259] Loaded cluster ID: f5906fa7d92d4e1195b6ff41f1f497bb
05:51:55.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.727608 22069 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:51:55.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.728716 22069 catalog_manager.cc:1504] Loading token signing keys...
05:51:55.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.729529 22069 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9: Loaded TSK: 0
05:51:55.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.730340 22069 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:51:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.801811 21335 master_runner.cc:186] Error getting master registration for 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111), 
05:51:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:55.802034 21335 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:51:56.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.011420 21403 master_runner.cc:186] Error getting master registration for 127.20.211.60:40403: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111), 
05:51:56.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.017104 21403 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:51:56.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.209594 21376 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [term 2 FOLLOWER]: Refusing update from remote peer 1ffd6e984cee4b69b88a86d7a6a6d2b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
05:51:56.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.210278 22067 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
05:51:56.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.212036 22061 sys_catalog.cc:455] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ffd6e984cee4b69b88a86d7a6a6d2b9. Latest consensus state: current_term: 2 leader_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:56.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.212349 22061 sys_catalog.cc:458] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: This master's current role is: FOLLOWER
05:51:56.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.214938 22067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:56.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.215363 22067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 [sys.catalog]: This master's current role is: LEADER
05:51:56.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.215732 22061 sys_catalog.cc:455] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52a0bf0ba1d443b90f132011a81148b" member_type: VOTER last_known_addr { host: "127.20.211.62" port: 38361 } } peers { permanent_uuid: "1ffd6e984cee4b69b88a86d7a6a6d2b9" member_type: VOTER last_known_addr { host: "127.20.211.61" port: 38971 } } peers { permanent_uuid: "601c9f50121645bebbc53d2d67c8ae92" member_type: VOTER last_known_addr { host: "127.20.211.60" port: 40403 } } }
05:51:56.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:56.215981 22061 sys_catalog.cc:458] T 00000000000000000000000000000000 P b52a0bf0ba1d443b90f132011a81148b [sys.catalog]: This master's current role is: FOLLOWER
05:51:56.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:56.216508 21423 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1ffd6e984cee4b69b88a86d7a6a6d2b9 -> Peer 601c9f50121645bebbc53d2d67c8ae92 (127.20.211.60:40403): Couldn't send request to peer 601c9f50121645bebbc53d2d67c8ae92. Status: Network error: Client connection negotiation failed: client connection to 127.20.211.60:40403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
05:51:56.947 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.20.211.60:40403(127.20.211.60:40403)] connecting to peer
05:51:56.949 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:56.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.60:40403(127.20.211.60:40403)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:56.949 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.211.60:40403: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403
05:51:56.952 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:51:56.956 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableSchema, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=50000, elapsed=2577), Traces: [0ms] sending RPC to server master-127.20.211.60:40403, [6ms] received response from server master-127.20.211.60:40403: Network error: connection closed, [6ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [12ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [14ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [16ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [16ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [18ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [22ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [32ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [36ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [38ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [39ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [52ms] refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [56ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [56ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [58ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [73ms] refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [76ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [76ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [79ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [92ms] refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [97ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [98ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [100ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [112ms] refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [116ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [118ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [119ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [212ms] refreshing cache from master, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [216ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [216ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [218ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [252ms] refreshing cache from master, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [252ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [256ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [258ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [258ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [352ms] refreshing cache from master, [352ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [353ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [356ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [356ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [358ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [358ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [1093ms] refreshing cache from master, [1093ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [1094ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [1094ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [1096ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, [1105ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [1106ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [1107ms] delaying RPC due to: Service unavailable: Master config (127.20.211.62:38361,127.20.211.61:38971,127.20.211.60:40403) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [2572ms] refreshing cache from master, [2572ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.62:38361, [2573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.61:38971, [2573ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.211.60:40403, [2575ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.60:40403: Network error: Failed to connect to peer master-127.20.211.60:40403(127.20.211.60:40403): Connection refused: /127.20.211.60:40403, [2575ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.62:38361: OK, [2577ms] Sub RPC ConnectToMaster: received response from server master-127.20.211.61:38971: OK, deferred=Deferred@356394506(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$79/851682458@4e051d19 -> wakeup thread Time-limited test -> (continuation of Deferred@1386214824 after retry RPC after error@1046468353) -> (continuation of Deferred@1521858742 after retry RPC after error@1010731820) -> (continuation of Deferred@287378358 after retry RPC after error@1367748940) -> (continuation of Deferred@637617090 after retry RPC after error@1856953285) -> (continuation of Deferred@2009796893 after retry RPC after error@396837625) -> (continuation of Deferred@991169692 after retry RPC after error@595368136) -> (continuation of Deferred@202389059 after retry RPC after error@562896306) -> (continuation of Deferred@988190195 after retry RPC after error@2098979007) -> (continuation of Deferred@1890874225 after retry RPC after error@958234712) -> (continuation of Deferred@937083781 after retry RPC after error@367449049), errback=passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1386214824 after retry RPC after error@1046468353) -> (continuation of Deferred@1521858742 after retry RPC after error@1010731820) -> (continuation of Deferred@287378358 after retry RPC after error@1367748940) -> (continuation of Deferred@637617090 after retry RPC after error@1856953285) -> (continuation of Deferred@2009796893 after retry RPC after error@396837625) -> (continuation of Deferred@991169692 after retry RPC after error@595368136) -> (continuation of Deferred@202389059 after retry RPC after error@562896306) -> (continuation of Deferred@988190195 after retry RPC after error@2098979007) -> (continuation of Deferred@1890874225 after retry RPC after error@958234712) -> (continuation of Deferred@937083781 after retry RPC after error@367449049))) after lookup
05:51:56.961 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table a1382aba88ea4734b89fe3275374779f
05:51:56.984 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1e0163610fa344de9a791ef347c4f4cc for table 'TestMasterFailover-killBefore=OPEN_TABLE' with partition [<start>, <end>)
05:51:56.990 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=1e0163610fa344de9a791ef347c4f4cc@[b4d11e4461124100977b1c29c49a88f1(127.20.211.2:37643)[L],d1fe201f5b5344e380679c5a36af8fc7(127.20.211.3:43367),de3300ec121e431482920270ac8f99a9(127.20.211.1:38627)]}]
05:51:56.992 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=16), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.20.211.61:38971, [8ms] Sub RPC GetTableLocations: received response from server master-127.20.211.61:38971: OK, deferred=null)) after lookup
05:51:57.006 [DEBUG - kudu-nio-1] (Connection.java:748) [peer b4d11e4461124100977b1c29c49a88f1(127.20.211.2:37643)] connecting to peer
05:51:57.008 [DEBUG - kudu-nio-0] (Connection.java:757) [peer b4d11e4461124100977b1c29c49a88f1(127.20.211.2:37643)] Successfully connected to peer
05:51:57.052 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x60b83738, L:/127.0.0.1:57008 - R:/127.20.211.2:37643] using TOKEN/null
05:51:57.074 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=OPEN_TABLE, tablet=1e0163610fa344de9a791ef347c4f4cc, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
05:51:57.085 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:51:57.086 [DEBUG - main] (Connection.java:575) [peer master-127.20.211.62:38361(127.20.211.62:38361)] disconnecting while in state READY
05:51:57.088 [DEBUG - main] (Connection.java:575) [peer b4d11e4461124100977b1c29c49a88f1(127.20.211.2:37643)] disconnecting while in state READY
05:51:57.088 [DEBUG - main] (Connection.java:575) [peer master-127.20.211.60:40403(127.20.211.60:40403)] disconnecting while in state TERMINATED
05:51:57.088 [DEBUG - main] (Connection.java:575) [peer master-127.20.211.61:38971(127.20.211.61:38971)] disconnecting while in state READY
05:51:57.099 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.211.61:38971(127.20.211.61:38971)] handling channelInactive
05:51:57.099 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.211.61:38971(127.20.211.61:38971)] cleaning up while in state READY due to: connection closed
05:51:57.101 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:51:57.102 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.211.62:38361(127.20.211.62:38361)] handling channelInactive
05:51:57.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.211.62:38361(127.20.211.62:38361)] cleaning up while in state READY due to: connection closed
05:51:57.102 [DEBUG - kudu-nio-0] (Connection.java:239) [peer b4d11e4461124100977b1c29c49a88f1(127.20.211.2:37643)] handling channelInactive
05:51:57.102 [DEBUG - kudu-nio-0] (Connection.java:709) [peer b4d11e4461124100977b1c29c49a88f1(127.20.211.2:37643)] cleaning up while in state READY due to: connection closed
05:51:57.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.103856 21324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 21605
05:51:57.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.117208 21727 generic_service.cc:196] Checking for leaks (request via RPC)
05:51:57.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.203804 21871 heartbeater.cc:503] Master 127.20.211.61:38971 was elected leader, sending a full tablet report...
05:51:57.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.248124 21324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 21605
05:51:57.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.267023 21324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 21742
05:51:57.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.275267 21864 generic_service.cc:196] Checking for leaks (request via RPC)
05:51:57.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.387082 21324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 21742
05:51:57.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:57.404677 21892 connection.cc:535] server connection from 127.20.211.2:57501 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
05:51:57.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.404984 21324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 21876
05:51:57.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.412128 21998 generic_service.cc:196] Checking for leaks (request via RPC)
05:51:57.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.505434 21324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 21876
05:51:57.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.522603 21324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 21335
05:51:57.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.523893 21396 generic_service.cc:196] Checking for leaks (request via RPC)
05:51:57.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.630461 21324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 21335
05:51:57.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.649828 21324 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 21403
05:51:57.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.651058 21467 generic_service.cc:196] Checking for leaks (request via RPC)
05:51:57.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:57.759022 21324 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 21403
05:51:57.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:51:57Z chronyd exiting
.05:51:58.173 [INFO - main] (RandomUtils.java:49) Using random seed: 1783489918173
05:51:58.176 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
05:51:58.177 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
05:51:58.177 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskAojDjo/test-tmp
05:51:58.177 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
05:51:58.177 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskAojDjo/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
05:51:58.180 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

05:51:58.506 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:51:58.507 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

05:51:58.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.509370 22094 mini_oidc.cc:152] Starting JWKS server
05:51:58.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.512284 22094 webserver.cc:460] Webserver started at http://127.0.0.1:42625/ using document root <none> and password file <none>
05:51:58.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.512504 22094 mini_oidc.cc:189] Starting OIDC Discovery server
05:51:58.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.513078 22094 webserver.cc:460] Webserver started at http://127.0.0.1:33585/ using document root <none> and password file <none>
05:51:58.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:51:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
05:51:58.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:51:58Z Disabled control of system clock
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.543241 22094 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/logs
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data/info.pb
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.190:38305
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.190
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:58.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42625/jwks.json with env {}
05:51:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.874740 22105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.875051 22105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:58.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.875136 22105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:58.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.882587 22105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:51:58.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.882699 22105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.882741 22105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:51:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.882789 22105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:51:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.882827 22105 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:51:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.882879 22105 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42625/jwks.json
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.894980 22105 master_runner.cc:386] Master server non-default flags:
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data
05:51:58.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.190:38305
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42625/jwks.json
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data/info.pb
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.190
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/logs
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:58.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:58.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:58.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:58.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:58.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.898758 22105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:58.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.901259 22105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:58.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.915553 22110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:58.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.916039 22105 server_base.cc:1034] running on GCE node
05:51:58.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.915704 22113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:58.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:58.915556 22111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:58.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.917160 22105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:58.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.918690 22105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:58.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.919966 22105 hybrid_clock.cc:648] HybridClock initialized: now 1783489918919859 us; error 57 us; skew 500 ppm
05:51:58.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.920343 22105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:58.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.922976 22105 webserver.cc:460] Webserver started at http://127.21.147.190:37141/ using document root <none> and password file <none>
05:51:58.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.923792 22105 fs_manager.cc:359] Metadata directory not provided
05:51:58.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.923900 22105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:58.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.924142 22105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.926764 22105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data/instance:
05:51:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "668b68893e8746d5b71d950e53f6dba2"
05:51:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:58 on dist-test-slave-fnnq"
05:51:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.927556 22105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal/instance:
05:51:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "668b68893e8746d5b71d950e53f6dba2"
05:51:58.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:58 on dist-test-slave-fnnq"
05:51:58.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.932789 22105 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
05:51:58.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.936257 22119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:58.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.937662 22105 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.937798 22105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "668b68893e8746d5b71d950e53f6dba2"
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:58 on dist-test-slave-fnnq"
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.937960 22105 fs_report.cc:383] FS layout report
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data/data
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:58.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:58.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:58.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.974711 22105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:58.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.975654 22105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:58.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.975953 22105 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:58.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.996083 22105 rpc_server.cc:307] RPC server started. Bound to: 127.21.147.190:38305
05:51:58.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.996106 22170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.147.190:38305 every 8 connection(s)
05:51:58.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:58.997645 22105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/data/info.pb
05:51:59.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.002161 22171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:59.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.003206 22094 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22105
05:51:59.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.003494 22094 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-0/wal/instance
05:51:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.005599 22094 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal
05:51:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data
05:51:59.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/logs
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data/info.pb
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.189:42509
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.189
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:51:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42625/jwks.json with env {}
05:51:59.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.010237 22171 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.044579 22171 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.045883 22123 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.147.189:42509: connect: Connection refused (error 111)
05:51:59.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.047585 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.189:42509: Network error: Client connection negotiation failed: client connection to 127.21.147.189:42509: connect: Connection refused (error 111)
05:51:59.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.096973 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } attempt: 1
05:51:59.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.099124 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.189:42509: Network error: Client connection negotiation failed: client connection to 127.21.147.189:42509: connect: Connection refused (error 111)
05:51:59.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.167402 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } attempt: 2
05:51:59.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.169646 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.189:42509: Network error: Client connection negotiation failed: client connection to 127.21.147.189:42509: connect: Connection refused (error 111)
05:51:59.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.260901 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } attempt: 3
05:51:59.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.262835 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.189:42509: Network error: Client connection negotiation failed: client connection to 127.21.147.189:42509: connect: Connection refused (error 111)
05:51:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.334257 22173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.334595 22173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.334714 22173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.342090 22173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:51:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.342223 22173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.342284 22173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:51:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.342356 22173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:51:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.342414 22173 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:51:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.342486 22173 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42625/jwks.json
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.351723 22173 master_runner.cc:386] Master server non-default flags:
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.189:42509
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42625/jwks.json
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data/info.pb
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.189
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:59.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/logs
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:59.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.353374 22173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:59.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.355218 22173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:59.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.366865 22182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:59.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.366976 22181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:59.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.367997 22184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:59.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.368173 22173 server_base.cc:1034] running on GCE node
05:51:59.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.368991 22173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:59.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.370323 22173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:59.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.371603 22173 hybrid_clock.cc:648] HybridClock initialized: now 1783489919371525 us; error 48 us; skew 500 ppm
05:51:59.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.371961 22173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:59.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.374302 22173 webserver.cc:460] Webserver started at http://127.21.147.189:39039/ using document root <none> and password file <none>
05:51:59.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.374981 22173 fs_manager.cc:359] Metadata directory not provided
05:51:59.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.375133 22173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:59.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.375447 22173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.378010 22173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data/instance:
05:51:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d20494abe5db4f40b242d4994d19c219"
05:51:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:59 on dist-test-slave-fnnq"
05:51:59.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.378826 22173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal/instance:
05:51:59.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d20494abe5db4f40b242d4994d19c219"
05:51:59.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:59 on dist-test-slave-fnnq"
05:51:59.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.383843 22173 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.004s
05:51:59.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.387182 22190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:59.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.388494 22173 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:51:59.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.388682 22173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal
05:51:59.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d20494abe5db4f40b242d4994d19c219"
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:59 on dist-test-slave-fnnq"
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.388913 22173 fs_report.cc:383] FS layout report
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data/data
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:59.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:59.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.406059 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } attempt: 4
05:51:59.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.408063 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.189:42509: Network error: Client connection negotiation failed: client connection to 127.21.147.189:42509: connect: Connection refused (error 111)
05:51:59.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.410332 22173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:59.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.411319 22173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:59.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.411684 22173 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:59.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.435420 22173 rpc_server.cc:307] RPC server started. Bound to: 127.21.147.189:42509
05:51:59.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.435550 22241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.147.189:42509 every 8 connection(s)
05:51:59.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.436888 22173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/data/info.pb
05:51:59.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.440721 22242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:59.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.442662 22094 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22173
05:51:59.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.442823 22094 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-1/wal/instance
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.444048 22094 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/logs
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data/info.pb
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.188:35019
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.188
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:59.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42625/jwks.json with env {}
05:51:59.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.449232 22242 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.468174 22242 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.477911 22242 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.478902 22193 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.480436 22242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.529774 22242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 1
05:51:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.531844 22242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.600119 22242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 2
05:51:59.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.602535 22242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.693804 22242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 3
05:51:59.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.695952 22242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.707327 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } attempt: 5
05:51:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.714841 22171 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.717567 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.768819 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 1
05:51:59.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.770874 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.774298 22244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:51:59.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.774570 22244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:51:59.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.774655 22244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:51:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.781981 22244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:51:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.782086 22244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:51:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.782131 22244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:51:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.782178 22244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:51:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.782215 22244 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:51:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.782264 22244 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42625/jwks.json
05:51:59.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.791425 22244 master_runner.cc:386] Master server non-default flags:
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.188:35019
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42625/jwks.json
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data/info.pb
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.188
05:51:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/logs
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:51:59.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.793063 22244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:51:59.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.794941 22244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:51:59.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.807763 22253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:59.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.807837 22255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:59.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.807734 22252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:51:59.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.808564 22244 server_base.cc:1034] running on GCE node
05:51:59.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.809409 22244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:51:59.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.810961 22244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:51:59.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.812179 22244 hybrid_clock.cc:648] HybridClock initialized: now 1783489919812073 us; error 53 us; skew 500 ppm
05:51:59.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.812574 22244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:51:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.815028 22244 webserver.cc:460] Webserver started at http://127.21.147.188:44869/ using document root <none> and password file <none>
05:51:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.815881 22244 fs_manager.cc:359] Metadata directory not provided
05:51:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.816039 22244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:51:59.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.816381 22244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:51:59.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.819231 22244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data/instance:
05:51:59.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0e7d79666a54e3081c649a28a4fec52"
05:51:59.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:59 on dist-test-slave-fnnq"
05:51:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.820225 22244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal/instance:
05:51:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0e7d79666a54e3081c649a28a4fec52"
05:51:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:59 on dist-test-slave-fnnq"
05:51:59.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.825915 22244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
05:51:59.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.829603 22261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.831017 22244 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.831254 22244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a0e7d79666a54e3081c649a28a4fec52"
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:51:59 on dist-test-slave-fnnq"
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.831537 22244 fs_report.cc:383] FS layout report
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal
05:51:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data/data
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:51:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:51:59.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.839123 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 2
05:51:59.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.839156 22242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 4
05:51:59.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.841126 22171 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.841347 22242 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:51:59.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.857410 22244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:51:59.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.858316 22244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:51:59.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.858688 22244 kserver.cc:163] Server-wide thread pool size limit: 3276
05:51:59.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.877482 22244 rpc_server.cc:307] RPC server started. Bound to: 127.21.147.188:35019
05:51:59.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.877516 22312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.147.188:35019 every 8 connection(s)
05:51:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.878890 22244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/data/info.pb
05:51:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.881150 22094 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22244
05:51:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.881310 22094 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/master-2/wal/instance
05:51:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.883380 22313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:51:59.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.892726 22313 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.908547 22313 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.915402 22313 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } has no permanent_uuid. Determining permanent_uuid...
05:51:59.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.925280 22313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: Bootstrap starting.
05:51:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.928741 22313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: Neither blocks nor log segments found. Creating new log.
05:51:59.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.929701 22313 log.cc:824] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: Log is configured to *not* fsync() on all Append() calls
05:51:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.932194 22313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: No bootstrap required, opened a new log
05:51:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.940985 22313 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:51:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.941288 22313 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.941361 22313 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0e7d79666a54e3081c649a28a4fec52, State: Initialized, Role: FOLLOWER
05:51:59.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.941825 22313 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:51:59.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.942659 22320 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:51:59.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.943006 22320 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: This master's current role is: FOLLOWER
05:51:59.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.943747 22313 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: configured and running, proceeding with master startup.
05:51:59.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.947391 22171 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 3
05:51:59.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.954303 22331 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:51:59.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.954653 22331 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:51:59.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.961380 22171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: Bootstrap starting.
05:51:59.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.951445 22244 master_runner.cc:186] Error getting master registration for 127.21.147.190:38305: OK, instance_id { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" instance_seqno: 1783489918990416 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:51:59.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.963761 22244 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:51:59.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.965389 22171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: Neither blocks nor log segments found. Creating new log.
05:51:59.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.966454 22171 log.cc:824] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: Log is configured to *not* fsync() on all Append() calls
05:51:59.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.970243 22171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: No bootstrap required, opened a new log
05:51:59.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.977624 22171 raft_consensus.cc:348] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:51:59.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.977982 22171 raft_consensus.cc:374] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:51:59.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.978101 22171 raft_consensus.cc:729] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668b68893e8746d5b71d950e53f6dba2, State: Initialized, Role: FOLLOWER
05:51:59.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.978806 22171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:51:59.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.980865 22334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:51:59.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.981482 22334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: This master's current role is: FOLLOWER
05:51:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.982282 22171 sys_catalog.cc:564] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: configured and running, proceeding with master startup.
05:51:59.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.992504 22345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:51:59.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:51:59.992903 22345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:00.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:51:59.991983 22105 master_runner.cc:186] Error getting master registration for 127.21.147.189:42509: OK, instance_id { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" instance_seqno: 1783489919430186 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:52:00.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.005980 22105 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:00.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.047734 22320 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:00.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.048048 22320 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:00.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.049751 22320 leader_election.cc:288] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 668b68893e8746d5b71d950e53f6dba2 (127.21.147.190:38305), d20494abe5db4f40b242d4994d19c219 (127.21.147.189:42509)
05:52:00.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.050463 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0e7d79666a54e3081c649a28a4fec52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668b68893e8746d5b71d950e53f6dba2" is_pre_election: true
05:52:00.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.051076 22146 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0e7d79666a54e3081c649a28a4fec52 in term 0.
05:52:00.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.051748 22264 leader_election.cc:302] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 668b68893e8746d5b71d950e53f6dba2, a0e7d79666a54e3081c649a28a4fec52; no voters: 
05:52:00.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.052165 22320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:00.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.052314 22320 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:00.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.052403 22320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 0 FOLLOWER]: Advancing to term 1
05:52:00.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.055603 22320 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.056908 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0e7d79666a54e3081c649a28a4fec52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668b68893e8746d5b71d950e53f6dba2"
05:52:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.057121 22146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 0 FOLLOWER]: Advancing to term 1
05:52:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.057404 22320 leader_election.cc:288] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [CANDIDATE]: Term 1 election: Requested vote from peers 668b68893e8746d5b71d950e53f6dba2 (127.21.147.190:38305), d20494abe5db4f40b242d4994d19c219 (127.21.147.189:42509)
05:52:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.060298 22146 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0e7d79666a54e3081c649a28a4fec52 in term 1.
05:52:00.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.061000 22264 leader_election.cc:302] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 668b68893e8746d5b71d950e53f6dba2, a0e7d79666a54e3081c649a28a4fec52; no voters: 
05:52:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.062281 22320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 1 FOLLOWER]: Leader election won for term 1
05:52:00.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.063570 22320 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [term 1 LEADER]: Becoming Leader. State: Replica: a0e7d79666a54e3081c649a28a4fec52, State: Running, Role: LEADER
05:52:00.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.064646 22320 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:00.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.078351 22347 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0e7d79666a54e3081c649a28a4fec52. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.079262 22347 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: This master's current role is: LEADER
05:52:00.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.080578 22349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:52:00.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.082978 22349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:52:00.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.094691 22146 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Refusing update from remote peer a0e7d79666a54e3081c649a28a4fec52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:52:00.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.095693 22347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:00.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.111135 22267 tablet.cc:2369] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:00.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.116086 22334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0e7d79666a54e3081c649a28a4fec52. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.116415 22334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: This master's current role is: FOLLOWER
05:52:00.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.118744 22350 mvcc.cc:205] Tried to move back new op lower bound from 7305174712692498432 to 7305174712593547264. Current Snapshot: MvccSnapshot[applied={T|T < 7305174712692498432}]
05:52:00.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.121286 22349 catalog_manager.cc:1347] Generated new cluster ID: 9d6acbc1852b4d3cbf09efa0d93737a2
05:52:00.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.121387 22349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:52:00.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.122889 22347 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.123167 22347 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: This master's current role is: LEADER
05:52:00.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.127758 22351 mvcc.cc:205] Tried to move back new op lower bound from 7305174712692498432 to 7305174712593547264. Current Snapshot: MvccSnapshot[applied={T|T < 7305174712692498432}]
05:52:00.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.140192 22334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.140475 22334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: This master's current role is: FOLLOWER
05:52:00.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.140527 22242 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } attempt: 5
05:52:00.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.154682 22242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: Bootstrap starting.
05:52:00.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.160619 22349 catalog_manager.cc:1370] Generated new certificate authority record
05:52:00.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.162735 22349 catalog_manager.cc:1504] Loading token signing keys...
05:52:00.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.174444 22242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: Neither blocks nor log segments found. Creating new log.
05:52:00.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.176436 22242 log.cc:824] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: Log is configured to *not* fsync() on all Append() calls
05:52:00.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.185601 22242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: No bootstrap required, opened a new log
05:52:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.188958 22349 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52: Generated new TSK 0
05:52:00.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.190850 22349 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:52:00.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.202541 22242 raft_consensus.cc:348] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:00.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.203186 22242 raft_consensus.cc:374] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:00.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.203426 22242 raft_consensus.cc:729] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d20494abe5db4f40b242d4994d19c219, State: Initialized, Role: FOLLOWER
05:52:00.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.204308 22242 consensus_queue.cc:260] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:00.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.210611 22094 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/logs
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data/info.pb
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:00.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.129:0
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.147.129
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.129
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:00.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:00.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.233289 22242 sys_catalog.cc:564] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: configured and running, proceeding with master startup.
05:52:00.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.233821 22217 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0e7d79666a54e3081c649a28a4fec52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20494abe5db4f40b242d4994d19c219" is_pre_election: true
05:52:00.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.233330 22216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a0e7d79666a54e3081c649a28a4fec52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d20494abe5db4f40b242d4994d19c219"
05:52:00.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.238294 22215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 0 FOLLOWER]: Advancing to term 1
05:52:00.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.243304 22215 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 1 FOLLOWER]: Refusing update from remote peer a0e7d79666a54e3081c649a28a4fec52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:52:00.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.245785 22320 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:00.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.252839 22357 sys_catalog.cc:455] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.254043 22357 sys_catalog.cc:458] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: This master's current role is: FOLLOWER
05:52:00.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.294790 22365 mvcc.cc:205] Tried to move back new op lower bound from 7305174712692498432 to 7305174712593547264. Current Snapshot: MvccSnapshot[applied={T|T < 7305174712692498432}]
05:52:00.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.324505 22357 sys_catalog.cc:455] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0e7d79666a54e3081c649a28a4fec52. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.324838 22357 sys_catalog.cc:458] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: This master's current role is: FOLLOWER
05:52:00.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.326067 22362 sys_catalog.cc:455] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.326391 22362 sys_catalog.cc:458] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: This master's current role is: FOLLOWER
05:52:00.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.351042 22374 catalog_manager.cc:1259] Loaded cluster ID: 9d6acbc1852b4d3cbf09efa0d93737a2
05:52:00.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.351476 22374 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: loading cluster ID for follower catalog manager: success
05:52:00.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.355368 22374 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: acquiring CA information for follower catalog manager: success
05:52:00.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.362643 22374 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:52:00.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.706681 22358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:00.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.707031 22358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:00.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.707150 22358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:00.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.714864 22358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:00.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.715104 22358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.147.129
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.726312 22358 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.129:0
05:52:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data/info.pb
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.129
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.147.129
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/logs
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:00.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.728021 22358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:00.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.729836 22358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:00.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.745797 22381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:00.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.746152 22380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:00.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:00.745707 22383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:00.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.747180 22358 server_base.cc:1034] running on GCE node
05:52:00.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.747923 22358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:00.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.749053 22358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:00.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.750315 22358 hybrid_clock.cc:648] HybridClock initialized: now 1783489920750240 us; error 53 us; skew 500 ppm
05:52:00.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.750710 22358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:00.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.753296 22358 webserver.cc:460] Webserver started at http://127.21.147.129:44641/ using document root <none> and password file <none>
05:52:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.753947 22358 fs_manager.cc:359] Metadata directory not provided
05:52:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.754047 22358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.754287 22358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:00.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.755311 22320 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0e7d79666a54e3081c649a28a4fec52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:00.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.755589 22320 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0e7d79666a54e3081c649a28a4fec52 [sys.catalog]: This master's current role is: LEADER
05:52:00.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.758065 22358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data/instance:
05:52:00.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39fde5f120aa408aaf9b542e004951d4"
05:52:00.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:00 on dist-test-slave-fnnq"
05:52:00.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.759326 22358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal/instance:
05:52:00.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39fde5f120aa408aaf9b542e004951d4"
05:52:00.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:00 on dist-test-slave-fnnq"
05:52:00.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.770092 22358 fs_manager.cc:691] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.005s
05:52:00.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.773605 22392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.775029 22358 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.775163 22358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39fde5f120aa408aaf9b542e004951d4"
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:00 on dist-test-slave-fnnq"
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.775322 22358 fs_report.cc:383] FS layout report
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data/data
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:00.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:00.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.795240 22358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:00.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.796175 22358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:00.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.796422 22358 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:00.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.797413 22358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:00.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.799069 22358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:00.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.799204 22358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:00.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.799324 22358 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:00.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.799373 22358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:00.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.832607 22358 rpc_server.cc:307] RPC server started. Bound to: 127.21.147.129:38593
05:52:00.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.832685 22504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.147.129:38593 every 8 connection(s)
05:52:00.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.833895 22358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/data/info.pb
05:52:00.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.838581 22094 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22358
05:52:00.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.838784 22094 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-0/wal/instance
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.843245 22094 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/logs
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data/info.pb
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:00.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.130:0
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.147.130
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.130
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:00.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.854614 22505 heartbeater.cc:347] Connected to a master server at 127.21.147.188:35019
05:52:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.854661 22507 heartbeater.cc:347] Connected to a master server at 127.21.147.189:42509
05:52:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.854944 22505 heartbeater.cc:464] Registering TS with master...
05:52:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.854950 22507 heartbeater.cc:464] Registering TS with master...
05:52:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.855432 22506 heartbeater.cc:347] Connected to a master server at 127.21.147.190:38305
05:52:00.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.855597 22506 heartbeater.cc:464] Registering TS with master...
05:52:00.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.856122 22507 heartbeater.cc:511] Master 127.21.147.189:42509 requested a full tablet report, sending...
05:52:00.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.856143 22506 heartbeater.cc:511] Master 127.21.147.190:38305 requested a full tablet report, sending...
05:52:00.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.857510 22505 heartbeater.cc:511] Master 127.21.147.188:35019 requested a full tablet report, sending...
05:52:00.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.858760 22136 ts_manager.cc:194] Registered new tserver with Master: 39fde5f120aa408aaf9b542e004951d4 (127.21.147.129:38593)
05:52:00.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.858757 22207 ts_manager.cc:194] Registered new tserver with Master: 39fde5f120aa408aaf9b542e004951d4 (127.21.147.129:38593)
05:52:00.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.859031 22278 ts_manager.cc:194] Registered new tserver with Master: 39fde5f120aa408aaf9b542e004951d4 (127.21.147.129:38593)
05:52:00.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.860538 22278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.147.129:54197
05:52:00.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.994917 22345 catalog_manager.cc:1259] Loaded cluster ID: 9d6acbc1852b4d3cbf09efa0d93737a2
05:52:00.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.995013 22345 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: loading cluster ID for follower catalog manager: success
05:52:00.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.997529 22345 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: acquiring CA information for follower catalog manager: success
05:52:00.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:00.999372 22345 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:52:01.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.182507 22515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:01.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.182796 22515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:01.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.182878 22515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:01.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.190269 22515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:01.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.190436 22515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.147.130
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.199756 22515 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.130:0
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data/info.pb
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.130
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.147.130
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/logs
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:01.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:01.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.201015 22515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:01.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.202703 22515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:01.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.215979 22520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:01.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.215930 22521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:01.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.216707 22523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:01.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.217067 22515 server_base.cc:1034] running on GCE node
05:52:01.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.217648 22515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:01.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.218519 22515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:01.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.219760 22515 hybrid_clock.cc:648] HybridClock initialized: now 1783489921219673 us; error 50 us; skew 500 ppm
05:52:01.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.220031 22515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:01.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.222473 22515 webserver.cc:460] Webserver started at http://127.21.147.130:38307/ using document root <none> and password file <none>
05:52:01.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.223122 22515 fs_manager.cc:359] Metadata directory not provided
05:52:01.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.223222 22515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:01.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.223461 22515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:01.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.226189 22515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data/instance:
05:52:01.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e829968b60e540f9918467548d625998"
05:52:01.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:01 on dist-test-slave-fnnq"
05:52:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.226958 22515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal/instance:
05:52:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e829968b60e540f9918467548d625998"
05:52:01.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:01 on dist-test-slave-fnnq"
05:52:01.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.232148 22515 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
05:52:01.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.235780 22529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.237296 22515 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.237425 22515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e829968b60e540f9918467548d625998"
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:01 on dist-test-slave-fnnq"
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.237587 22515 fs_report.cc:383] FS layout report
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data/data
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:01.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:01.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:01.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.269824 22515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:01.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.270617 22515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:01.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.270864 22515 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:01.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.271833 22515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:01.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.273365 22515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:01.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.273437 22515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:01.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.273518 22515 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:01.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.273553 22515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:01.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.306910 22515 rpc_server.cc:307] RPC server started. Bound to: 127.21.147.130:44715
05:52:01.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.306998 22642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.147.130:44715 every 8 connection(s)
05:52:01.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.308303 22515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/data/info.pb
05:52:01.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.313347 22094 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22515
05:52:01.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.313520 22094 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-1/wal/instance
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.317425 22094 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/logs
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data/info.pb
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:01.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.131:0
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.147.131
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.131
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:01.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:01.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.328742 22644 heartbeater.cc:347] Connected to a master server at 127.21.147.190:38305
05:52:01.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.328817 22643 heartbeater.cc:347] Connected to a master server at 127.21.147.188:35019
05:52:01.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.329138 22643 heartbeater.cc:464] Registering TS with master...
05:52:01.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.329135 22644 heartbeater.cc:464] Registering TS with master...
05:52:01.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.330166 22644 heartbeater.cc:511] Master 127.21.147.190:38305 requested a full tablet report, sending...
05:52:01.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.330505 22643 heartbeater.cc:511] Master 127.21.147.188:35019 requested a full tablet report, sending...
05:52:01.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.330966 22645 heartbeater.cc:347] Connected to a master server at 127.21.147.189:42509
05:52:01.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.331087 22645 heartbeater.cc:464] Registering TS with master...
05:52:01.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.331550 22645 heartbeater.cc:511] Master 127.21.147.189:42509 requested a full tablet report, sending...
05:52:01.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.331915 22136 ts_manager.cc:194] Registered new tserver with Master: e829968b60e540f9918467548d625998 (127.21.147.130:44715)
05:52:01.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.331933 22278 ts_manager.cc:194] Registered new tserver with Master: e829968b60e540f9918467548d625998 (127.21.147.130:44715)
05:52:01.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.332932 22278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.147.130:49261
05:52:01.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.333863 22207 ts_manager.cc:194] Registered new tserver with Master: e829968b60e540f9918467548d625998 (127.21.147.130:44715)
05:52:01.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.646878 22650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:01.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.647145 22650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:01.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.647224 22650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:01.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.654335 22650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:01.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.654502 22650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.147.131
05:52:01.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.663434 22650 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:01.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:01.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.147.148:34581
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.147.131:0
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data/info.pb
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.147.131
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.147.190:38305,127.21.147.189:42509,127.21.147.188:35019
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.147.131
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/logs
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:01.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:01.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.665030 22650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:01.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.667346 22650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:01.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.681840 22658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:01.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.681895 22655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:01.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:01.681869 22656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:01.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.682616 22650 server_base.cc:1034] running on GCE node
05:52:01.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.683255 22650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:01.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.684286 22650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:01.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.685523 22650 hybrid_clock.cc:648] HybridClock initialized: now 1783489921685458 us; error 32 us; skew 500 ppm
05:52:01.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.685935 22650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:01.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.688238 22650 webserver.cc:460] Webserver started at http://127.21.147.131:35749/ using document root <none> and password file <none>
05:52:01.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.688913 22650 fs_manager.cc:359] Metadata directory not provided
05:52:01.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.689054 22650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:01.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.689385 22650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:01.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.692003 22650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data/instance:
05:52:01.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cb3bca05e4f94137989d82ddc1e2b5d2"
05:52:01.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:01 on dist-test-slave-fnnq"
05:52:01.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.692801 22650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal/instance:
05:52:01.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cb3bca05e4f94137989d82ddc1e2b5d2"
05:52:01.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:01 on dist-test-slave-fnnq"
05:52:01.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.697656 22650 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
05:52:01.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.700879 22664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.702042 22650 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.702225 22650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cb3bca05e4f94137989d82ddc1e2b5d2"
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:01 on dist-test-slave-fnnq"
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.702435 22650 fs_report.cc:383] FS layout report
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data/data
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:01.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:01.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:01.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.719115 22650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:01.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.719924 22650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:01.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.720171 22650 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:01.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.721215 22650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.723191 22650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.723282 22650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.723400 22650 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.723461 22650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:01.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.761286 22650 rpc_server.cc:307] RPC server started. Bound to: 127.21.147.131:46589
05:52:01.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.761325 22776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.147.131:46589 every 8 connection(s)
05:52:01.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.762567 22650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/data/info.pb
05:52:01.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.768013 22094 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22650
05:52:01.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.768251 22094 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster6733917849196198424/ts-2/wal/instance
05:52:01.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.780699 22779 heartbeater.cc:347] Connected to a master server at 127.21.147.189:42509
05:52:01.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.780774 22778 heartbeater.cc:347] Connected to a master server at 127.21.147.190:38305
05:52:01.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.781044 22778 heartbeater.cc:464] Registering TS with master...
05:52:01.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.781047 22779 heartbeater.cc:464] Registering TS with master...
05:52:01.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.781219 22777 heartbeater.cc:347] Connected to a master server at 127.21.147.188:35019
05:52:01.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.781337 22777 heartbeater.cc:464] Registering TS with master...
05:52:01.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.782284 22778 heartbeater.cc:511] Master 127.21.147.190:38305 requested a full tablet report, sending...
05:52:01.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.782546 22777 heartbeater.cc:511] Master 127.21.147.188:35019 requested a full tablet report, sending...
05:52:01.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.782574 22779 heartbeater.cc:511] Master 127.21.147.189:42509 requested a full tablet report, sending...
05:52:01.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.784055 22278 ts_manager.cc:194] Registered new tserver with Master: cb3bca05e4f94137989d82ddc1e2b5d2 (127.21.147.131:46589)
05:52:01.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.784091 22207 ts_manager.cc:194] Registered new tserver with Master: cb3bca05e4f94137989d82ddc1e2b5d2 (127.21.147.131:46589)
05:52:01.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.784288 22136 ts_manager.cc:194] Registered new tserver with Master: cb3bca05e4f94137989d82ddc1e2b5d2 (127.21.147.131:46589)
05:52:01.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.785138 22278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.147.131:46861
05:52:01.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.793581 22094 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
05:52:01.795 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:52:01.796 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

05:52:01.799 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.147.190"
      port: 38305
    }
    bound_http_address {
      host: "127.21.147.190"
      port: 37141
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.147.189"
      port: 42509
    }
    bound_http_address {
      host: "127.21.147.189"
      port: 39039
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.147.188"
      port: 35019
    }
    bound_http_address {
      host: "127.21.147.188"
      port: 44869
    }
  }
}

05:52:01.799 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

05:52:01.801 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.147.129"
      port: 38593
    }
    bound_http_address {
      host: "127.21.147.129"
      port: 44641
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.147.130"
      port: 44715
    }
    bound_http_address {
      host: "127.21.147.130"
      port: 38307
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.147.131"
      port: 46589
    }
    bound_http_address {
      host: "127.21.147.131"
      port: 35749
    }
  }
}

05:52:01.801 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
05:52:01.806 [ERROR - main] (ResourceLeakDetector.java:327) LEAK: HashedWheelTimer.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
Recent access records: 
Created at:
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:312)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:251)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:224)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:203)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:185)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:296)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:431)
	org.apache.kudu.client.AsyncKuduScanner$AsyncKuduScannerBuilder.build(AsyncKuduScanner.java:1417)
	org.apache.kudu.client.TestMasterFailover.doTestKillLeader(TestMasterFailover.java:94)
	org.apache.kudu.client.TestMasterFailover.testKillLeaderBeforeOpenTable(TestMasterFailover.java:56)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
05:52:01.809 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:52:01.811 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.21.147.189:42509(127.21.147.189:42509)] connecting to peer
05:52:01.812 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:01.813 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.21.147.190:38305(127.21.147.190:38305)] connecting to peer
05:52:01.816 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.147.188:35019(127.21.147.188:35019)] Successfully connected to peer
05:52:01.818 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.147.189:42509(127.21.147.189:42509)] Successfully connected to peer
05:52:01.820 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.147.188
05:52:01.820 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.147.190:38305(127.21.147.190:38305)] Successfully connected to peer
05:52:01.822 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.147.189
05:52:01.830 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.147.190
05:52:01.843 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x920f58e1, L:/127.0.0.1:50604 - R:/127.21.147.188:35019] using SASL/PLAIN
05:52:01.846 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:52:01.846 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=36), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [35ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: OK, deferred=null) after lookup
05:52:01.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.863018 22505 heartbeater.cc:503] Master 127.21.147.188:35019 was elected leader, sending a full tablet report...
05:52:01.865 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x3c68b642, L:/127.0.0.1:52768 - R:/127.21.147.189:42509] using SASL/PLAIN
05:52:01.868 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x24f8754f, L:/127.0.0.1:41074 - R:/127.21.147.190:38305] using SASL/PLAIN
05:52:01.872 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.21.147.188:35019
05:52:01.872 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

05:52:01.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.873234 22094 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22244
05:52:01.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.874475 22308 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:01.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:01.981600 22094 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22244
05:52:02.001 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.147.188:35019(127.21.147.188:35019)] handling channelInactive
05:52:02.001 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state READY due to: connection closed
05:52:02.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:02.001956 22122 connection.cc:535] server connection from 127.0.0.1:41072 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
05:52:02.002 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
05:52:02.004 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:52:02.005 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.007 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.007 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.007 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.21.147.188:35019(127.21.147.188:35019) for tablet Kudu Master: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.011 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.014 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.014 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.014 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.015 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.032 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.034 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.034 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.034 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.035 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.051 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.054 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.054 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.055 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.056 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.071 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.072 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.073 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.073 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.074 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.091 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.094 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.094 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.095 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.111 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.113 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.113 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.114 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.115 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.151 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.154 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.154 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.155 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.156 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:02.335923 22643 heartbeater.cc:503] Master 127.21.147.188:35019 was elected leader, sending a full tablet report...
05:52:02.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:02.337244 22643 heartbeater.cc:644] Failed to heartbeat to 127.21.147.188:35019 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:52:02.352 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.353 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.354 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.354 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.355 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.531 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:02.534 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.534 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.534 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:02.535 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:02.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:02.787252 22777 heartbeater.cc:503] Master 127.21.147.188:35019 was elected leader, sending a full tablet report...
05:52:02.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:02.788646 22777 heartbeater.cc:644] Failed to heartbeat to 127.21.147.188:35019 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:52:02.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:02.866389 22505 heartbeater.cc:644] Failed to heartbeat to 127.21.147.188:35019 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:52:03.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.251480 22792 raft_consensus.cc:482] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0e7d79666a54e3081c649a28a4fec52)
05:52:03.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.251772 22792 raft_consensus.cc:504] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:03.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.253037 22792 leader_election.cc:288] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 668b68893e8746d5b71d950e53f6dba2 (127.21.147.190:38305), a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019)
05:52:03.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.253710 22145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d20494abe5db4f40b242d4994d19c219" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "668b68893e8746d5b71d950e53f6dba2" is_pre_election: true
05:52:03.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:03.255157 22193 leader_election.cc:334] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019): Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:52:03.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.255290 22193 leader_election.cc:302] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d20494abe5db4f40b242d4994d19c219; no voters: 668b68893e8746d5b71d950e53f6dba2, a0e7d79666a54e3081c649a28a4fec52
05:52:03.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.255637 22792 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
05:52:03.311 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:03.313 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:03.313 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:03.314 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:03.315 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305; will retry
05:52:03.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.482800 22796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a0e7d79666a54e3081c649a28a4fec52)
05:52:03.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.483031 22796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:03.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.484458 22796 leader_election.cc:288] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d20494abe5db4f40b242d4994d19c219 (127.21.147.189:42509), a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019)
05:52:03.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.485044 22216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "668b68893e8746d5b71d950e53f6dba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d20494abe5db4f40b242d4994d19c219" is_pre_election: true
05:52:03.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.485389 22216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 668b68893e8746d5b71d950e53f6dba2 in term 1.
05:52:03.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.485910 22123 leader_election.cc:302] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 668b68893e8746d5b71d950e53f6dba2, d20494abe5db4f40b242d4994d19c219; no voters: 
05:52:03.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.486366 22796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Leader pre-election won for term 2
05:52:03.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.486512 22796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a0e7d79666a54e3081c649a28a4fec52)
05:52:03.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.486655 22796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 1 FOLLOWER]: Advancing to term 2
05:52:03.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:03.487098 22122 leader_election.cc:334] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019): Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:52:03.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.488751 22796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:03.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.489317 22796 leader_election.cc:288] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [CANDIDATE]: Term 2 election: Requested vote from peers d20494abe5db4f40b242d4994d19c219 (127.21.147.189:42509), a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019)
05:52:03.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.489787 22216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "668b68893e8746d5b71d950e53f6dba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d20494abe5db4f40b242d4994d19c219"
05:52:03.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.490049 22216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 1 FOLLOWER]: Advancing to term 2
05:52:03.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:03.490741 22122 leader_election.cc:334] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019): Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111)
05:52:03.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.492153 22216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 668b68893e8746d5b71d950e53f6dba2 in term 2.
05:52:03.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.492516 22123 leader_election.cc:302] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 668b68893e8746d5b71d950e53f6dba2, d20494abe5db4f40b242d4994d19c219; no voters: a0e7d79666a54e3081c649a28a4fec52
05:52:03.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.492789 22796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 2 FOLLOWER]: Leader election won for term 2
05:52:03.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.493206 22796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [term 2 LEADER]: Becoming Leader. State: Replica: 668b68893e8746d5b71d950e53f6dba2, State: Running, Role: LEADER
05:52:03.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.493577 22796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } }
05:52:03.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.494992 22799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 668b68893e8746d5b71d950e53f6dba2. Latest consensus state: current_term: 2 leader_uuid: "668b68893e8746d5b71d950e53f6dba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:03.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.495328 22799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: This master's current role is: LEADER
05:52:03.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.495931 22801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:52:03.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.497529 22801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:52:03.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.498255 22801 catalog_manager.cc:1259] Loaded cluster ID: 9d6acbc1852b4d3cbf09efa0d93737a2
05:52:03.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.498322 22801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:52:03.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.499344 22801 catalog_manager.cc:1504] Loading token signing keys...
05:52:03.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.500138 22801 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2: Loaded TSK: 0
05:52:03.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.500931 22801 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:52:03.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.871299 22216 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [term 2 FOLLOWER]: Refusing update from remote peer 668b68893e8746d5b71d950e53f6dba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
05:52:03.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.871994 22799 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
05:52:03.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.873708 22804 sys_catalog.cc:455] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 668b68893e8746d5b71d950e53f6dba2. Latest consensus state: current_term: 2 leader_uuid: "668b68893e8746d5b71d950e53f6dba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:03.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.873998 22804 sys_catalog.cc:458] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: This master's current role is: FOLLOWER
05:52:03.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.875523 22796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "668b68893e8746d5b71d950e53f6dba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:03.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.875911 22796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 [sys.catalog]: This master's current role is: LEADER
05:52:03.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:03.877197 22122 consensus_peers.cc:487] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 -> Peer a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019): Couldn't send request to peer a0e7d79666a54e3081c649a28a4fec52. Status: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
05:52:03.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.877501 22804 sys_catalog.cc:455] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "668b68893e8746d5b71d950e53f6dba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668b68893e8746d5b71d950e53f6dba2" member_type: VOTER last_known_addr { host: "127.21.147.190" port: 38305 } } peers { permanent_uuid: "d20494abe5db4f40b242d4994d19c219" member_type: VOTER last_known_addr { host: "127.21.147.189" port: 42509 } } peers { permanent_uuid: "a0e7d79666a54e3081c649a28a4fec52" member_type: VOTER last_known_addr { host: "127.21.147.188" port: 35019 } } }
05:52:03.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:03.877738 22804 sys_catalog.cc:458] T 00000000000000000000000000000000 P d20494abe5db4f40b242d4994d19c219 [sys.catalog]: This master's current role is: FOLLOWER
05:52:04.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:04.387692 22122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111) [suppressed 10 similar messages]
05:52:04.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.790030 22778 heartbeater.cc:503] Master 127.21.147.190:38305 was elected leader, sending a full tablet report...
05:52:04.831 [DEBUG - pool-7-thread-1] (Connection.java:748) [peer master-127.21.147.188:35019(127.21.147.188:35019)] connecting to peer
05:52:04.835 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:04.835 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.188:35019(127.21.147.188:35019)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:04.835 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.21.147.188:35019: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019
05:52:04.837 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:52:04.839 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=50000, elapsed=2832), Traces: [0ms] sending RPC to server master-127.21.147.188:35019, [2ms] received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [5ms] refreshing cache from master, [5ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [6ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [9ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [9ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [10ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [10ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [26ms] refreshing cache from master, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [29ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [29ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [30ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [30ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [46ms] refreshing cache from master, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [46ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [49ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [50ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [51ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [65ms] refreshing cache from master, [65ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [66ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [68ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [68ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [69ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [69ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [85ms] refreshing cache from master, [85ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [88ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [89ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [90ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [90ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [106ms] refreshing cache from master, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [109ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [109ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [110ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [110ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [145ms] refreshing cache from master, [145ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [146ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [149ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [150ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [150ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [151ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [346ms] refreshing cache from master, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [346ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [348ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [349ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [349ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [350ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [350ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [525ms] refreshing cache from master, [525ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [526ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [527ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [528ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [529ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [530ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [530ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [1305ms] refreshing cache from master, [1305ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [1306ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [1307ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [1308ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [1308ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [1309ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, [1310ms] delaying RPC due to: Service unavailable: Master config (127.21.147.189:42509,127.21.147.188:35019,127.21.147.190:38305) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [2826ms] refreshing cache from master, [2826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.189:42509, [2826ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.188:35019, [2827ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.147.190:38305, [2829ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.189:42509: OK, [2830ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.188:35019: Network error: Failed to connect to peer master-127.21.147.188:35019(127.21.147.188:35019): Connection refused: /127.21.147.188:35019, [2831ms] Sub RPC ConnectToMaster: received response from server master-127.21.147.190:38305: OK, deferred=Deferred@612746118(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$71/1218344705@372d49f5 -> org.apache.kudu.client.AsyncKuduClient$$Lambda$72/1606002157@6b3fc846 -> wakeup thread Time-limited test -> (continuation of Deferred@1024724456 after retry RPC after error@923234367) -> (continuation of Deferred@1782117835 after retry RPC after error@2144369970) -> (continuation of Deferred@1656116333 after retry RPC after error@1849443980) -> (continuation of Deferred@1124556845 after retry RPC after error@1061338258) -> (continuation of Deferred@1862767147 after retry RPC after error@1661186401) -> (continuation of Deferred@461222692 after retry RPC after error@837892853) -> (continuation of Deferred@1647599658 after retry RPC after error@482500020) -> (continuation of Deferred@1792027035 after retry RPC after error@1380876454) -> (continuation of Deferred@330993653 after retry RPC after error@496717771) -> (continuation of Deferred@1986801938 after retry RPC after error@1342297289), errback=passthrough -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1024724456 after retry RPC after error@923234367) -> (continuation of Deferred@1782117835 after retry RPC after error@2144369970) -> (continuation of Deferred@1656116333 after retry RPC after error@1849443980) -> (continuation of Deferred@1124556845 after retry RPC after error@1061338258) -> (continuation of Deferred@1862767147 after retry RPC after error@1661186401) -> (continuation of Deferred@461222692 after retry RPC after error@837892853) -> (continuation of Deferred@1647599658 after retry RPC after error@482500020) -> (continuation of Deferred@1792027035 after retry RPC after error@1380876454) -> (continuation of Deferred@330993653 after retry RPC after error@496717771) -> (continuation of Deferred@1986801938 after retry RPC after error@1342297289))) after lookup
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.841984 22136 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41074:
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=CREATE_CLIENT"
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:04.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:04.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:52:04.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:04.844286 22136 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=CREATE_CLIENT in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
05:52:04.856 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 680248f36414474fbd1f2a1a40585239
05:52:04.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.866751 22506 heartbeater.cc:503] Master 127.21.147.190:38305 was elected leader, sending a full tablet report...
05:52:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.874567 22440 tablet_service.cc:1467] Processing CreateTablet for tablet a1dae41f99634f0b81a3f716607e31a4 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=680248f36414474fbd1f2a1a40585239]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:04.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.876221 22440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1dae41f99634f0b81a3f716607e31a4. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:04.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.879719 22578 tablet_service.cc:1467] Processing CreateTablet for tablet a1dae41f99634f0b81a3f716607e31a4 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=680248f36414474fbd1f2a1a40585239]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.881093 22578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1dae41f99634f0b81a3f716607e31a4. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:04.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.882715 22712 tablet_service.cc:1467] Processing CreateTablet for tablet a1dae41f99634f0b81a3f716607e31a4 (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_CLIENT [id=680248f36414474fbd1f2a1a40585239]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:04.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.883899 22712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1dae41f99634f0b81a3f716607e31a4. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:04.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.897756 22826 tablet_bootstrap.cc:492] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: Bootstrap starting.
05:52:04.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.900380 22827 tablet_bootstrap.cc:492] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: Bootstrap starting.
05:52:04.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.901904 22826 tablet_bootstrap.cc:654] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: Neither blocks nor log segments found. Creating new log.
05:52:04.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.903172 22826 log.cc:824] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: Log is configured to *not* fsync() on all Append() calls
05:52:04.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.905046 22827 tablet_bootstrap.cc:654] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: Neither blocks nor log segments found. Creating new log.
05:52:04.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.905714 22828 tablet_bootstrap.cc:492] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: Bootstrap starting.
05:52:04.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.907121 22826 tablet_bootstrap.cc:492] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: No bootstrap required, opened a new log
05:52:04.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.907334 22826 ts_tablet_manager.cc:1397] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
05:52:04.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.908707 22827 log.cc:824] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: Log is configured to *not* fsync() on all Append() calls
05:52:04.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.908996 22828 tablet_bootstrap.cc:654] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: Neither blocks nor log segments found. Creating new log.
05:52:04.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.910049 22828 log.cc:824] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: Log is configured to *not* fsync() on all Append() calls
05:52:04.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.912945 22827 tablet_bootstrap.cc:492] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: No bootstrap required, opened a new log
05:52:04.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.913225 22827 ts_tablet_manager.cc:1397] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.000s
05:52:04.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.913949 22828 tablet_bootstrap.cc:492] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: No bootstrap required, opened a new log
05:52:04.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.914326 22828 ts_tablet_manager.cc:1397] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
05:52:04.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.916139 22826 raft_consensus.cc:348] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.916450 22826 raft_consensus.cc:374] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:04.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.916514 22826 raft_consensus.cc:729] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39fde5f120aa408aaf9b542e004951d4, State: Initialized, Role: FOLLOWER
05:52:04.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.917037 22826 consensus_queue.cc:260] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.918747 22826 ts_tablet_manager.cc:1428] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
05:52:04.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.924592 22828 raft_consensus.cc:348] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.924906 22828 raft_consensus.cc:374] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:04.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.924968 22828 raft_consensus.cc:729] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3bca05e4f94137989d82ddc1e2b5d2, State: Initialized, Role: FOLLOWER
05:52:04.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.925490 22828 consensus_queue.cc:260] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.925604 22827 raft_consensus.cc:348] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.926059 22827 raft_consensus.cc:374] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:04.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.926163 22827 raft_consensus.cc:729] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e829968b60e540f9918467548d625998, State: Initialized, Role: FOLLOWER
05:52:04.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.926810 22827 consensus_queue.cc:260] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.927186 22828 ts_tablet_manager.cc:1428] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
05:52:04.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.928742 22827 ts_tablet_manager.cc:1428] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
05:52:04.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.929011 22644 heartbeater.cc:503] Master 127.21.147.190:38305 was elected leader, sending a full tablet report...
05:52:04.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.985972 22833 raft_consensus.cc:482] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:04.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.986274 22833 raft_consensus.cc:504] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:04.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.987884 22833 leader_election.cc:288] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39fde5f120aa408aaf9b542e004951d4 (127.21.147.129:38593), e829968b60e540f9918467548d625998 (127.21.147.130:44715)
05:52:04.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.995420 22460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1dae41f99634f0b81a3f716607e31a4" candidate_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39fde5f120aa408aaf9b542e004951d4" is_pre_election: true
05:52:04.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.996068 22460 raft_consensus.cc:2454] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb3bca05e4f94137989d82ddc1e2b5d2 in term 0.
05:52:04.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.996474 22598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1dae41f99634f0b81a3f716607e31a4" candidate_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e829968b60e540f9918467548d625998" is_pre_election: true
05:52:04.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.996778 22666 leader_election.cc:302] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39fde5f120aa408aaf9b542e004951d4, cb3bca05e4f94137989d82ddc1e2b5d2; no voters: 
05:52:04.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.997033 22598 raft_consensus.cc:2454] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb3bca05e4f94137989d82ddc1e2b5d2 in term 0.
05:52:04.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.997179 22833 raft_consensus.cc:2781] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:04.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.997319 22833 raft_consensus.cc:482] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:04.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.997411 22833 raft_consensus.cc:3037] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 0 FOLLOWER]: Advancing to term 1
05:52:04.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:04.999603 22833 raft_consensus.cc:504] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:05.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.000286 22833 leader_election.cc:288] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [CANDIDATE]: Term 1 election: Requested vote from peers 39fde5f120aa408aaf9b542e004951d4 (127.21.147.129:38593), e829968b60e540f9918467548d625998 (127.21.147.130:44715)
05:52:05.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.000604 22460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1dae41f99634f0b81a3f716607e31a4" candidate_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39fde5f120aa408aaf9b542e004951d4"
05:52:05.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.000758 22598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1dae41f99634f0b81a3f716607e31a4" candidate_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e829968b60e540f9918467548d625998"
05:52:05.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.000823 22460 raft_consensus.cc:3037] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [term 0 FOLLOWER]: Advancing to term 1
05:52:05.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.000952 22598 raft_consensus.cc:3037] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [term 0 FOLLOWER]: Advancing to term 1
05:52:05.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.002825 22460 raft_consensus.cc:2454] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb3bca05e4f94137989d82ddc1e2b5d2 in term 1.
05:52:05.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.003207 22666 leader_election.cc:302] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39fde5f120aa408aaf9b542e004951d4, cb3bca05e4f94137989d82ddc1e2b5d2; no voters: 
05:52:05.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.003573 22833 raft_consensus.cc:2781] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 1 FOLLOWER]: Leader election won for term 1
05:52:05.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.004081 22598 raft_consensus.cc:2454] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb3bca05e4f94137989d82ddc1e2b5d2 in term 1.
05:52:05.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.004783 22833 raft_consensus.cc:686] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [term 1 LEADER]: Becoming Leader. State: Replica: cb3bca05e4f94137989d82ddc1e2b5d2, State: Running, Role: LEADER
05:52:05.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.005308 22833 consensus_queue.cc:237] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } }
05:52:05.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.010941 22136 catalog_manager.cc:5495] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb3bca05e4f94137989d82ddc1e2b5d2 (127.21.147.131). New cstate: current_term: 1 leader_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb3bca05e4f94137989d82ddc1e2b5d2" member_type: VOTER last_known_addr { host: "127.21.147.131" port: 46589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 } health_report { overall_health: UNKNOWN } } }
05:52:05.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.011950 22105 master_runner.cc:186] Error getting master registration for 127.21.147.188:35019: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111), 
05:52:05.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.012144 22105 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:05.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.017470 22780 tablet.cc:2369] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:05.035 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 680248f36414474fbd1f2a1a40585239
05:52:05.039 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a1dae41f99634f0b81a3f716607e31a4 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
05:52:05.039 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a1dae41f99634f0b81a3f716607e31a4@[39fde5f120aa408aaf9b542e004951d4(127.21.147.129:38593),cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)[L],e829968b60e540f9918467548d625998(127.21.147.130:44715)]}]
05:52:05.039 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [2ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, deferred=null)) after lookup
05:52:05.040 [DEBUG - kudu-nio-0] (Connection.java:748) [peer cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)] connecting to peer
05:52:05.042 [DEBUG - kudu-nio-1] (Connection.java:757) [peer cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)] Successfully connected to peer
05:52:05.060 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x36e15fa1, L:/127.0.0.1:46574 - R:/127.21.147.131:46589] using TOKEN/null
05:52:05.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.063901 22692 tablet_service.cc:2908] Rejecting scan request for tablet a1dae41f99634f0b81a3f716607e31a4: Uninitialized: clean time has not yet been initialized
05:52:05.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.065594 22646 tablet.cc:2369] T a1dae41f99634f0b81a3f716607e31a4 P e829968b60e540f9918467548d625998: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:05.069 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589) for tablet a1dae41f99634f0b81a3f716607e31a4: clean time has not yet been initialized
05:52:05.073 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a1dae41f99634f0b81a3f716607e31a4 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
05:52:05.073 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a1dae41f99634f0b81a3f716607e31a4@[39fde5f120aa408aaf9b542e004951d4(127.21.147.129:38593),cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)[L],e829968b60e540f9918467548d625998(127.21.147.130:44715)]}]
05:52:05.074 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=3, KuduRpc(method=Scan, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=3, TimeoutTracker(timeout=30000, elapsed=37), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [2ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [4ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [33ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [33ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [35ms] refreshing cache from master, [35ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [37ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, deferred=Deferred@1238930014(state=PENDING, result=null, callback=(continuation of Deferred@449173110 after retry RPC@1579919177), errback=(continuation of Deferred@449173110 after retry RPC@1579919177)))) after lookup
05:52:05.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.076628 22692 tablet_service.cc:2908] Rejecting scan request for tablet a1dae41f99634f0b81a3f716607e31a4: Uninitialized: clean time has not yet been initialized
05:52:05.077 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589) for tablet a1dae41f99634f0b81a3f716607e31a4: clean time has not yet been initialized
05:52:05.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.089591 22508 tablet.cc:2369] T a1dae41f99634f0b81a3f716607e31a4 P 39fde5f120aa408aaf9b542e004951d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:05.113 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a1dae41f99634f0b81a3f716607e31a4 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
05:52:05.113 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a1dae41f99634f0b81a3f716607e31a4@[39fde5f120aa408aaf9b542e004951d4(127.21.147.129:38593),cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)[L],e829968b60e540f9918467548d625998(127.21.147.130:44715)]}]
05:52:05.114 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=5, KuduRpc(method=Scan, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=5, TimeoutTracker(timeout=30000, elapsed=77), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [2ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [4ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [33ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [33ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [35ms] refreshing cache from master, [35ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [37ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [38ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [77ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, deferred=Deferred@1238930014(state=PENDING, result=null, callback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961), errback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961)))) after lookup
05:52:05.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.116727 22692 tablet_service.cc:2908] Rejecting scan request for tablet a1dae41f99634f0b81a3f716607e31a4: Uninitialized: clean time has not yet been initialized
05:52:05.117 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589) for tablet a1dae41f99634f0b81a3f716607e31a4: clean time has not yet been initialized
05:52:05.173 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a1dae41f99634f0b81a3f716607e31a4 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
05:52:05.173 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a1dae41f99634f0b81a3f716607e31a4@[39fde5f120aa408aaf9b542e004951d4(127.21.147.129:38593),cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)[L],e829968b60e540f9918467548d625998(127.21.147.130:44715)]}]
05:52:05.174 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=7, KuduRpc(method=Scan, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=7, TimeoutTracker(timeout=30000, elapsed=137), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [2ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [4ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [33ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [33ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [35ms] refreshing cache from master, [35ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [37ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [38ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [77ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [78ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [81ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [81ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [134ms] refreshing cache from master, [134ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [136ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, deferred=Deferred@1238930014(state=PENDING, result=null, callback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961) -> (continuation of Deferred@2091293737 after retry RPC@1915837631), errback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961) -> (continuation of Deferred@2091293737 after retry RPC@1915837631)))) after lookup
05:52:05.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.177385 22692 tablet_service.cc:2908] Rejecting scan request for tablet a1dae41f99634f0b81a3f716607e31a4: Uninitialized: clean time has not yet been initialized
05:52:05.178 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589) for tablet a1dae41f99634f0b81a3f716607e31a4: clean time has not yet been initialized
05:52:05.374 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a1dae41f99634f0b81a3f716607e31a4 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
05:52:05.374 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a1dae41f99634f0b81a3f716607e31a4@[39fde5f120aa408aaf9b542e004951d4(127.21.147.129:38593),cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)[L],e829968b60e540f9918467548d625998(127.21.147.130:44715)]}]
05:52:05.375 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=9, KuduRpc(method=Scan, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=9, TimeoutTracker(timeout=30000, elapsed=338), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [2ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [4ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [33ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [33ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [35ms] refreshing cache from master, [35ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [37ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [38ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [77ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [78ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [81ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [81ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [134ms] refreshing cache from master, [134ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [136ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [138ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [142ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [142ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [335ms] refreshing cache from master, [335ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [337ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, deferred=Deferred@1238930014(state=PENDING, result=null, callback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961) -> (continuation of Deferred@2091293737 after retry RPC@1915837631) -> (continuation of Deferred@101093209 after retry RPC@1517758278), errback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961) -> (continuation of Deferred@2091293737 after retry RPC@1915837631) -> (continuation of Deferred@101093209 after retry RPC@1517758278)))) after lookup
05:52:05.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:05.378197 22692 tablet_service.cc:2908] Rejecting scan request for tablet a1dae41f99634f0b81a3f716607e31a4: Uninitialized: clean time has not yet been initialized
05:52:05.379 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589) for tablet a1dae41f99634f0b81a3f716607e31a4: clean time has not yet been initialized
05:52:05.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.390717 22833 consensus_queue.cc:1035] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39fde5f120aa408aaf9b542e004951d4" member_type: VOTER last_known_addr { host: "127.21.147.129" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:05.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:05.400013 22833 consensus_queue.cc:1035] T a1dae41f99634f0b81a3f716607e31a4 P cb3bca05e4f94137989d82ddc1e2b5d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e829968b60e540f9918467548d625998" member_type: VOTER last_known_addr { host: "127.21.147.130" port: 44715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:06.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:06.199146 22122 consensus_peers.cc:487] T 00000000000000000000000000000000 P 668b68893e8746d5b71d950e53f6dba2 -> Peer a0e7d79666a54e3081c649a28a4fec52 (127.21.147.188:35019): Couldn't send request to peer a0e7d79666a54e3081c649a28a4fec52. Status: Network error: Client connection negotiation failed: client connection to 127.21.147.188:35019: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
05:52:06.294 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a1dae41f99634f0b81a3f716607e31a4 for table 'TestMasterFailover-killBefore=CREATE_CLIENT' with partition [<start>, <end>)
05:52:06.294 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a1dae41f99634f0b81a3f716607e31a4@[39fde5f120aa408aaf9b542e004951d4(127.21.147.129:38593),cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)[L],e829968b60e540f9918467548d625998(127.21.147.130:44715)]}]
05:52:06.295 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=11, KuduRpc(method=Scan, tablet=a1dae41f99634f0b81a3f716607e31a4, attempt=11, TimeoutTracker(timeout=30000, elapsed=1258), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [2ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [4ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [33ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [33ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [35ms] refreshing cache from master, [35ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [37ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [38ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [42ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [42ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [74ms] refreshing cache from master, [74ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [77ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [78ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [81ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [81ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [134ms] refreshing cache from master, [134ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [136ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [138ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [142ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [142ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [335ms] refreshing cache from master, [335ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [337ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, [339ms] sending RPC to server cb3bca05e4f94137989d82ddc1e2b5d2, [343ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [343ms] received response from server cb3bca05e4f94137989d82ddc1e2b5d2: Uninitialized: clean time has not yet been initialized (error 0), [1255ms] refreshing cache from master, [1255ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.147.190:38305, [1258ms] Sub RPC GetTableLocations: received response from server master-127.21.147.190:38305: OK, deferred=Deferred@1238930014(state=PENDING, result=null, callback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961) -> (continuation of Deferred@2091293737 after retry RPC@1915837631) -> (continuation of Deferred@101093209 after retry RPC@1517758278) -> (continuation of Deferred@1106152767 after retry RPC@1939910172), errback=(continuation of Deferred@449173110 after retry RPC@1579919177) -> (continuation of Deferred@1898964676 after retry RPC@1164830961) -> (continuation of Deferred@2091293737 after retry RPC@1915837631) -> (continuation of Deferred@101093209 after retry RPC@1517758278) -> (continuation of Deferred@1106152767 after retry RPC@1939910172)))) after lookup
05:52:06.303 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=CREATE_CLIENT, tablet=a1dae41f99634f0b81a3f716607e31a4, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
05:52:06.303 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:52:06.304 [DEBUG - main] (Connection.java:575) [peer master-127.21.147.188:35019(127.21.147.188:35019)] disconnecting while in state TERMINATED
05:52:06.305 [DEBUG - main] (Connection.java:575) [peer cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)] disconnecting while in state READY
05:52:06.305 [DEBUG - main] (Connection.java:575) [peer master-127.21.147.190:38305(127.21.147.190:38305)] disconnecting while in state READY
05:52:06.305 [DEBUG - main] (Connection.java:575) [peer master-127.21.147.189:42509(127.21.147.189:42509)] disconnecting while in state READY
05:52:06.312 [DEBUG - kudu-nio-1] (Connection.java:239) [peer cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)] handling channelInactive
05:52:06.312 [DEBUG - kudu-nio-1] (Connection.java:709) [peer cb3bca05e4f94137989d82ddc1e2b5d2(127.21.147.131:46589)] cleaning up while in state READY due to: connection closed
05:52:06.312 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:52:06.313 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.147.190:38305(127.21.147.190:38305)] handling channelInactive
05:52:06.313 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.190:38305(127.21.147.190:38305)] cleaning up while in state READY due to: connection closed
05:52:06.314 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.147.189:42509(127.21.147.189:42509)] handling channelInactive
05:52:06.314 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.147.189:42509(127.21.147.189:42509)] cleaning up while in state READY due to: connection closed
05:52:06.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.314863 22094 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22358
05:52:06.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.326856 22500 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:06.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.422726 22094 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22358
05:52:06.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:06.440538 22191 connection.cc:535] server connection from 127.21.147.129:58329 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
05:52:06.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.441015 22094 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22515
05:52:06.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.449157 22638 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:06.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.542035 22094 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22515
05:52:06.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.559746 22094 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22650
05:52:06.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.567977 22772 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:06.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.689019 22094 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22650
05:52:06.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.708155 22094 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22105
05:52:06.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.709347 22166 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:06.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.820842 22094 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22105
05:52:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.840564 22094 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22173
05:52:06.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.841638 22237 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:06.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:06.948542 22094 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22173
05:52:06.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:06Z chronyd exiting
.05:52:07.108 [INFO - main] (RandomUtils.java:49) Using random seed: 1783489927108
05:52:07.110 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
05:52:07.111 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
05:52:07.111 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskAojDjo/test-tmp
05:52:07.112 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
05:52:07.112 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskAojDjo/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
05:52:07.113 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

05:52:07.428 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:52:07.428 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

05:52:07.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.430516 22869 mini_oidc.cc:152] Starting JWKS server
05:52:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.433252 22869 webserver.cc:460] Webserver started at http://127.0.0.1:36673/ using document root <none> and password file <none>
05:52:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.433578 22869 mini_oidc.cc:189] Starting OIDC Discovery server
05:52:07.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.434264 22869 webserver.cc:460] Webserver started at http://127.0.0.1:40241/ using document root <none> and password file <none>
05:52:07.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
05:52:07.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:07Z Disabled control of system clock
05:52:07.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.464702 22869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/logs
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data/info.pb
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.126:44565
05:52:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.126
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36673/jwks.json with env {}
05:52:07.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.780339 22880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:07.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.780613 22880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:07.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.780694 22880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.787858 22880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:52:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.787968 22880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.788012 22880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:52:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.788058 22880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:52:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.788096 22880 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:52:07.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.788147 22880 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:36673/jwks.json
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.797088 22880 master_runner.cc:386] Master server non-default flags:
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.126:44565
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36673/jwks.json
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data/info.pb
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.126
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/logs
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:07.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:07.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.798333 22880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:07.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.800396 22880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:07.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.812121 22886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:07.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.812212 22885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:07.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.812060 22888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.812927 22880 server_base.cc:1034] running on GCE node
05:52:07.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.813796 22880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:07.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.815158 22880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:07.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.816449 22880 hybrid_clock.cc:648] HybridClock initialized: now 1783489927816380 us; error 29 us; skew 500 ppm
05:52:07.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.816897 22880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:07.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.818984 22880 webserver.cc:460] Webserver started at http://127.22.85.126:35037/ using document root <none> and password file <none>
05:52:07.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.819671 22880 fs_manager.cc:359] Metadata directory not provided
05:52:07.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.819772 22880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:07.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.820006 22880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:07.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.822458 22880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data/instance:
05:52:07.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "35f6a641277f4afb91282acb7ac4808e"
05:52:07.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:07 on dist-test-slave-fnnq"
05:52:07.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.823149 22880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal/instance:
05:52:07.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "35f6a641277f4afb91282acb7ac4808e"
05:52:07.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:07 on dist-test-slave-fnnq"
05:52:07.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.828121 22880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
05:52:07.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.831270 22894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:07.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.832679 22880 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:52:07.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.832801 22880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "35f6a641277f4afb91282acb7ac4808e"
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:07 on dist-test-slave-fnnq"
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.832957 22880 fs_report.cc:383] FS layout report
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data/data
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:07.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:07.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.851204 22880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:07.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.852097 22880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:07.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.852361 22880 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:07.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.870765 22880 rpc_server.cc:307] RPC server started. Bound to: 127.22.85.126:44565
05:52:07.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.870787 22945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.85.126:44565 every 8 connection(s)
05:52:07.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.872187 22880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/data/info.pb
05:52:07.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.876029 22946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:07.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.880919 22869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22880
05:52:07.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.881189 22869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-0/wal/instance
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.882937 22946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } has no permanent_uuid. Determining permanent_uuid...
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.884011 22869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/logs
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data/info.pb
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.125:38831
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.125
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:07.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:07.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36673/jwks.json with env {}
05:52:07.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.902294 22946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } has no permanent_uuid. Determining permanent_uuid...
05:52:07.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.903359 22897 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.85.125:38831: connect: Connection refused (error 111)
05:52:07.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.904955 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.125:38831: Network error: Client connection negotiation failed: client connection to 127.22.85.125:38831: connect: Connection refused (error 111)
05:52:07.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:07.954324 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } attempt: 1
05:52:07.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:07.956563 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.125:38831: Network error: Client connection negotiation failed: client connection to 127.22.85.125:38831: connect: Connection refused (error 111)
05:52:08.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.024853 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } attempt: 2
05:52:08.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.026979 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.125:38831: Network error: Client connection negotiation failed: client connection to 127.22.85.125:38831: connect: Connection refused (error 111)
05:52:08.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.118270 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } attempt: 3
05:52:08.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.120428 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.125:38831: Network error: Client connection negotiation failed: client connection to 127.22.85.125:38831: connect: Connection refused (error 111)
05:52:08.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.214386 22950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:08.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.214644 22950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:08.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.214726 22950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:08.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.221732 22950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:52:08.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.221827 22950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:08.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.221869 22950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:52:08.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.221916 22950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:52:08.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.221953 22950 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:52:08.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.222003 22950 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:36673/jwks.json
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.230942 22950 master_runner.cc:386] Master server non-default flags:
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.125:38831
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36673/jwks.json
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data/info.pb
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.125
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/logs
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:08.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:08.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.232497 22950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:08.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.234524 22950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.246687 22957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.246901 22956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:08.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.247596 22959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:08.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.248291 22950 server_base.cc:1034] running on GCE node
05:52:08.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.249045 22950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:08.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.250504 22950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:08.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.251725 22950 hybrid_clock.cc:648] HybridClock initialized: now 1783489928251662 us; error 39 us; skew 500 ppm
05:52:08.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.252004 22950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:08.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.254312 22950 webserver.cc:460] Webserver started at http://127.22.85.125:43035/ using document root <none> and password file <none>
05:52:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.254900 22950 fs_manager.cc:359] Metadata directory not provided
05:52:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.254997 22950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.255244 22950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:08.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.257817 22950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data/instance:
05:52:08.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48bf54b0fc7f4b4b91afc81d235532e1"
05:52:08.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:08 on dist-test-slave-fnnq"
05:52:08.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.258503 22950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal/instance:
05:52:08.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48bf54b0fc7f4b4b91afc81d235532e1"
05:52:08.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:08 on dist-test-slave-fnnq"
05:52:08.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.263330 22950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
05:52:08.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.263670 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } attempt: 4
05:52:08.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.265588 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.125:38831: Network error: Client connection negotiation failed: client connection to 127.22.85.125:38831: connect: Connection refused (error 111)
05:52:08.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.266579 22965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.267935 22950 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.268065 22950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48bf54b0fc7f4b4b91afc81d235532e1"
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:08 on dist-test-slave-fnnq"
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.268241 22950 fs_report.cc:383] FS layout report
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data/data
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:08.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:08.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:08.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.287046 22950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:08.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.287902 22950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:08.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.288165 22950 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:08.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.306674 22950 rpc_server.cc:307] RPC server started. Bound to: 127.22.85.125:38831
05:52:08.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.306705 23016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.85.125:38831 every 8 connection(s)
05:52:08.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.307914 22950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/data/info.pb
05:52:08.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.311600 23017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:08.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.312624 22869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 22950
05:52:08.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.312772 22869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-1/wal/instance
05:52:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.313651 22869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal
05:52:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data
05:52:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:08.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/logs
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data/info.pb
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.124:45561
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.124
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:08.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36673/jwks.json with env {}
05:52:08.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.318964 23017 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.334988 23017 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.345157 23017 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.346328 22968 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.347910 23017 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.397231 23017 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 1
05:52:08.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.399377 23017 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.467759 23017 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 2
05:52:08.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.469784 23017 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.561088 23017 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 3
05:52:08.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.563134 23017 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.564819 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } attempt: 5
05:52:08.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.572757 22946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.574751 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.626022 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 1
05:52:08.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.628085 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.648051 23019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.648311 23019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.648398 23019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:08.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.655613 23019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:52:08.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.655709 23019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:08.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.655750 23019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:52:08.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.655797 23019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:52:08.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.655833 23019 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:52:08.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.655880 23019 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:36673/jwks.json
05:52:08.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.664714 23019 master_runner.cc:386] Master server non-default flags:
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.124:45561
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36673/jwks.json
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data/info.pb
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.124
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/logs
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:08.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:08.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.665997 23019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:08.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.668183 23019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:08.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.679915 23030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:08.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.679968 23028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:08.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.680130 23027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:08.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.681226 23019 server_base.cc:1034] running on GCE node
05:52:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.681902 23019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.683149 23019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:08.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.684399 23019 hybrid_clock.cc:648] HybridClock initialized: now 1783489928684323 us; error 46 us; skew 500 ppm
05:52:08.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.684772 23019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:08.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.686954 23019 webserver.cc:460] Webserver started at http://127.22.85.124:33711/ using document root <none> and password file <none>
05:52:08.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.687691 23019 fs_manager.cc:359] Metadata directory not provided
05:52:08.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.687839 23019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:08.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.688153 23019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:08.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.690732 23019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data/instance:
05:52:08.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9100bdb9143441d0920f646bd3893d22"
05:52:08.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:08 on dist-test-slave-fnnq"
05:52:08.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.691620 23019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal/instance:
05:52:08.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9100bdb9143441d0920f646bd3893d22"
05:52:08.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:08 on dist-test-slave-fnnq"
05:52:08.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.696352 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 2
05:52:08.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.696925 23019 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
05:52:08.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.698376 22946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.700590 23036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.701927 23019 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.702070 23019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "9100bdb9143441d0920f646bd3893d22"
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:08 on dist-test-slave-fnnq"
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.702315 23019 fs_report.cc:383] FS layout report
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data/data
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:08.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:08.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.706387 23017 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 4
05:52:08.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.708408 23017 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.85.124:45561: Network error: Client connection negotiation failed: client connection to 127.22.85.124:45561: connect: Connection refused (error 111)
05:52:08.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.718283 23019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:08.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.719038 23019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:08.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.719314 23019 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:08.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.739584 23019 rpc_server.cc:307] RPC server started. Bound to: 127.22.85.124:45561
05:52:08.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.739681 23087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.85.124:45561 every 8 connection(s)
05:52:08.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.740981 23019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/data/info.pb
05:52:08.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.745024 23088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.750936 22869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23019
05:52:08.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.751112 22869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/master-2/wal/instance
05:52:08.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.751591 23088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.768517 23088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.779001 23088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
05:52:08.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.789858 23088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: Bootstrap starting.
05:52:08.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.792857 23088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: Neither blocks nor log segments found. Creating new log.
05:52:08.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.793776 23088 log.cc:824] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: Log is configured to *not* fsync() on all Append() calls
05:52:08.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.796536 23088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: No bootstrap required, opened a new log
05:52:08.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.803910 23088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:08.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.804243 23088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:08.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.804349 23088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9100bdb9143441d0920f646bd3893d22, State: Initialized, Role: FOLLOWER
05:52:08.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.804629 22946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 3
05:52:08.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.804972 23088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:08.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.806445 23097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:08.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.807080 23097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: This master's current role is: FOLLOWER
05:52:08.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.807850 23088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: configured and running, proceeding with master startup.
05:52:08.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.817916 22946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: Bootstrap starting.
05:52:08.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.818363 23108 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:52:08.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.818642 23108 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:08.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.823352 22946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: Neither blocks nor log segments found. Creating new log.
05:52:08.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.824892 22946 log.cc:824] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: Log is configured to *not* fsync() on all Append() calls
05:52:08.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.816185 23019 master_runner.cc:186] Error getting master registration for 127.22.85.126:44565: OK, instance_id { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" instance_seqno: 1783489927865362 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:52:08.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.826860 23019 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:08.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.827957 22946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: No bootstrap required, opened a new log
05:52:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.839102 22946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.839690 22946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.839831 22946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35f6a641277f4afb91282acb7ac4808e, State: Initialized, Role: FOLLOWER
05:52:08.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.840523 22946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:08.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.841420 23111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:08.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.841952 23111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: This master's current role is: FOLLOWER
05:52:08.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.842825 22946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: configured and running, proceeding with master startup.
05:52:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.854812 22900 tablet.cc:2369] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.855767 23122 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:52:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.856019 23122 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.853009 22880 master_runner.cc:186] Error getting master registration for 127.22.85.125:38831: OK, instance_id { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" instance_seqno: 1783489928301436 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:52:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:08.864176 22880 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:08.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:08.971455 23042 tablet.cc:2369] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:09.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.007596 23017 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } attempt: 5
05:52:09.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.021047 23017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: Bootstrap starting.
05:52:09.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.025090 23017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: Neither blocks nor log segments found. Creating new log.
05:52:09.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.026435 23017 log.cc:824] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: Log is configured to *not* fsync() on all Append() calls
05:52:09.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.029551 23017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: No bootstrap required, opened a new log
05:52:09.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.041576 23017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:09.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.041975 23017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:09.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.042112 23017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bf54b0fc7f4b4b91afc81d235532e1, State: Initialized, Role: FOLLOWER
05:52:09.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.042883 23017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:09.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.043967 23125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.044589 23125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:09.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.045411 23017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: configured and running, proceeding with master startup.
05:52:09.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.067569 22950 master_runner.cc:263] No leader master found from master 48bf54b0fc7f4b4b91afc81d235532e1
05:52:09.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.067720 22950 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:09.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.070676 23136 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:52:09.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.071020 23136 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:09.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.092095 23111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:09.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.092366 23111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.093698 23111 leader_election.cc:288] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bf54b0fc7f4b4b91afc81d235532e1 (127.22.85.125:38831), 9100bdb9143441d0920f646bd3893d22 (127.22.85.124:45561)
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.094723 22992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35f6a641277f4afb91282acb7ac4808e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" is_pre_election: true
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.095374 22992 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35f6a641277f4afb91282acb7ac4808e in term 0.
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.095293 23063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35f6a641277f4afb91282acb7ac4808e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9100bdb9143441d0920f646bd3893d22" is_pre_election: true
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.095940 23063 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35f6a641277f4afb91282acb7ac4808e in term 0.
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.096028 22897 leader_election.cc:302] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35f6a641277f4afb91282acb7ac4808e, 48bf54b0fc7f4b4b91afc81d235532e1; no voters: 
05:52:09.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.096794 23111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:09.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.097008 23111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:09.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.097141 23111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 0 FOLLOWER]: Advancing to term 1
05:52:09.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.100374 23111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:09.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.101583 22992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35f6a641277f4afb91282acb7ac4808e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bf54b0fc7f4b4b91afc81d235532e1"
05:52:09.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.101797 22992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 0 FOLLOWER]: Advancing to term 1
05:52:09.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.105167 22992 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35f6a641277f4afb91282acb7ac4808e in term 1.
05:52:09.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.106391 23063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "35f6a641277f4afb91282acb7ac4808e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9100bdb9143441d0920f646bd3893d22"
05:52:09.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.106633 23063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 0 FOLLOWER]: Advancing to term 1
05:52:09.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.109887 23063 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35f6a641277f4afb91282acb7ac4808e in term 1.
05:52:09.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.110499 22897 leader_election.cc:302] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35f6a641277f4afb91282acb7ac4808e, 9100bdb9143441d0920f646bd3893d22; no voters: 
05:52:09.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.111276 23111 leader_election.cc:288] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [CANDIDATE]: Term 1 election: Requested vote from peers 48bf54b0fc7f4b4b91afc81d235532e1 (127.22.85.125:38831), 9100bdb9143441d0920f646bd3893d22 (127.22.85.124:45561)
05:52:09.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.111517 23111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 1 FOLLOWER]: Leader election won for term 1
05:52:09.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.111650 23111 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [term 1 LEADER]: Becoming Leader. State: Replica: 35f6a641277f4afb91282acb7ac4808e, State: Running, Role: LEADER
05:52:09.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.112223 23111 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:09.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.133348 23138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35f6a641277f4afb91282acb7ac4808e. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.134054 23138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: This master's current role is: LEADER
05:52:09.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.141331 23140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:52:09.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.144165 23140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:52:09.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.160452 23063 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Refusing update from remote peer 35f6a641277f4afb91282acb7ac4808e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:52:09.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.161718 23138 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:09.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.168977 22992 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Refusing update from remote peer 35f6a641277f4afb91282acb7ac4808e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:52:09.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.169929 23138 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:09.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.199282 23125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35f6a641277f4afb91282acb7ac4808e. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.199661 23125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:09.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.206792 23141 mvcc.cc:205] Tried to move back new op lower bound from 7305174749827878912 to 7305174749668642816. Current Snapshot: MvccSnapshot[applied={T|T < 7305174749827878912}]
05:52:09.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.212109 23143 mvcc.cc:205] Tried to move back new op lower bound from 7305174749827878912 to 7305174749668642816. Current Snapshot: MvccSnapshot[applied={T|T < 7305174749827878912}]
05:52:09.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.219491 23111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.219847 23111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: This master's current role is: LEADER
05:52:09.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.220007 23125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.220285 23125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:09.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.221524 23140 catalog_manager.cc:1347] Generated new cluster ID: 7c6aab56c9cf409497ac376efada43ed
05:52:09.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.221627 23140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:52:09.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.238492 23097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35f6a641277f4afb91282acb7ac4808e. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.238823 23097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: This master's current role is: FOLLOWER
05:52:09.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.251643 23138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.252170 23138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e [sys.catalog]: This master's current role is: LEADER
05:52:09.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.257398 23142 mvcc.cc:205] Tried to move back new op lower bound from 7305174749827878912 to 7305174749668642816. Current Snapshot: MvccSnapshot[applied={T|T < 7305174749827878912}]
05:52:09.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.266081 23097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "35f6a641277f4afb91282acb7ac4808e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:09.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.266395 23097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: This master's current role is: FOLLOWER
05:52:09.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.291927 23140 catalog_manager.cc:1370] Generated new certificate authority record
05:52:09.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.293905 23140 catalog_manager.cc:1504] Loading token signing keys...
05:52:09.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.314507 23140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35f6a641277f4afb91282acb7ac4808e: Generated new TSK 0
05:52:09.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.315469 23140 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.331069 22869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/logs
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data/info.pb
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:09.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.65:0
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.85.65
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.65
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:09.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:09.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.681805 23150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:09.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.682147 23150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:09.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.682264 23150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:09.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.689631 23150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:09.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.689857 23150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.85.65
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.698833 23150 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.65:0
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data/info.pb
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.65
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.85.65
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/logs
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.700548 23150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.702348 23150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.716264 23155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.716310 23158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:09.716358 23156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.717201 23150 server_base.cc:1034] running on GCE node
05:52:09.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.717777 23150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:09.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.718679 23150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:09.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.719923 23150 hybrid_clock.cc:648] HybridClock initialized: now 1783489929719828 us; error 61 us; skew 500 ppm
05:52:09.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.720286 23150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:09.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.722703 23150 webserver.cc:460] Webserver started at http://127.22.85.65:35291/ using document root <none> and password file <none>
05:52:09.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.723405 23150 fs_manager.cc:359] Metadata directory not provided
05:52:09.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.723577 23150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:09.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.723894 23150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:09.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.726495 23150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data/instance:
05:52:09.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "99808c349a124ee1aca09d4e96dbef10"
05:52:09.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:09 on dist-test-slave-fnnq"
05:52:09.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.727298 23150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal/instance:
05:52:09.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "99808c349a124ee1aca09d4e96dbef10"
05:52:09.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:09 on dist-test-slave-fnnq"
05:52:09.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.732393 23150 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
05:52:09.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.736052 23164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:09.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.737617 23150 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.737794 23150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "99808c349a124ee1aca09d4e96dbef10"
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:09 on dist-test-slave-fnnq"
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.738013 23150 fs_report.cc:383] FS layout report
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data/data
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:09.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:09.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.755257 23150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:09.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.756130 23150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:09.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.756462 23150 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:09.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.757447 23150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:09.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.758948 23150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:09.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.759059 23150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:09.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.759181 23150 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:09.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.759229 23150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:09.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.793519 23150 rpc_server.cc:307] RPC server started. Bound to: 127.22.85.65:43179
05:52:09.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.793608 23276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.85.65:43179 every 8 connection(s)
05:52:09.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.794890 23150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/data/info.pb
05:52:09.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.799132 22869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23150
05:52:09.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.799381 22869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-0/wal/instance
05:52:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.807380 22869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal
05:52:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data
05:52:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/logs
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data/info.pb
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.66:0
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.85.66
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.66
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:09.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.821687 23108 catalog_manager.cc:1259] Loaded cluster ID: 7c6aab56c9cf409497ac376efada43ed
05:52:09.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.821815 23108 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: loading cluster ID for follower catalog manager: success
05:52:09.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.826696 23108 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: acquiring CA information for follower catalog manager: success
05:52:09.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.831190 23108 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:52:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.845830 23278 heartbeater.cc:347] Connected to a master server at 127.22.85.126:44565
05:52:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.846227 23278 heartbeater.cc:464] Registering TS with master...
05:52:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.846776 23279 heartbeater.cc:347] Connected to a master server at 127.22.85.125:38831
05:52:09.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.846923 23279 heartbeater.cc:464] Registering TS with master...
05:52:09.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.847311 23278 heartbeater.cc:511] Master 127.22.85.126:44565 requested a full tablet report, sending...
05:52:09.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.847407 23279 heartbeater.cc:511] Master 127.22.85.125:38831 requested a full tablet report, sending...
05:52:09.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.849351 22910 ts_manager.cc:194] Registered new tserver with Master: 99808c349a124ee1aca09d4e96dbef10 (127.22.85.65:43179)
05:52:09.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.849583 22982 ts_manager.cc:194] Registered new tserver with Master: 99808c349a124ee1aca09d4e96dbef10 (127.22.85.65:43179)
05:52:09.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.851032 22910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.85.65:34577
05:52:09.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.857445 23277 heartbeater.cc:347] Connected to a master server at 127.22.85.124:45561
05:52:09.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.857602 23277 heartbeater.cc:464] Registering TS with master...
05:52:09.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.857981 23277 heartbeater.cc:511] Master 127.22.85.124:45561 requested a full tablet report, sending...
05:52:09.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:09.859453 23053 ts_manager.cc:194] Registered new tserver with Master: 99808c349a124ee1aca09d4e96dbef10 (127.22.85.65:43179)
05:52:10.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.073150 23136 catalog_manager.cc:1259] Loaded cluster ID: 7c6aab56c9cf409497ac376efada43ed
05:52:10.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.073282 23136 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: loading cluster ID for follower catalog manager: success
05:52:10.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.075812 23136 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: acquiring CA information for follower catalog manager: success
05:52:10.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.077512 23136 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:52:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.151268 23287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.151542 23287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.151623 23287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:10.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.158552 23287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:10.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.158712 23287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.85.66
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.167337 23287 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.66:0
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data/info.pb
05:52:10.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.66
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.85.66
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/logs
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:10.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.168684 23287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:10.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.170356 23287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:10.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.183450 23294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:10.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.183457 23293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:10.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.183743 23296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:10.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.184340 23287 server_base.cc:1034] running on GCE node
05:52:10.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.184950 23287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:10.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.185949 23287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:10.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.187238 23287 hybrid_clock.cc:648] HybridClock initialized: now 1783489930187150 us; error 47 us; skew 500 ppm
05:52:10.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.187683 23287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:10.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.190225 23287 webserver.cc:460] Webserver started at http://127.22.85.66:40105/ using document root <none> and password file <none>
05:52:10.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.190969 23287 fs_manager.cc:359] Metadata directory not provided
05:52:10.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.191133 23287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:10.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.191593 23287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.194481 23287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data/instance:
05:52:10.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "74282ab72dbf4ab2a135a48bf201d86e"
05:52:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:10 on dist-test-slave-fnnq"
05:52:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.195329 23287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal/instance:
05:52:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "74282ab72dbf4ab2a135a48bf201d86e"
05:52:10.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:10 on dist-test-slave-fnnq"
05:52:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.201210 23287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
05:52:10.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.204901 23302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:10.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.206540 23287 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
05:52:10.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.206709 23287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "74282ab72dbf4ab2a135a48bf201d86e"
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:10 on dist-test-slave-fnnq"
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.206943 23287 fs_report.cc:383] FS layout report
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data/data
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:10.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:10.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.221274 23287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:10.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.222100 23287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:10.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.222447 23287 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:10.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.223445 23287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:10.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.225093 23287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:10.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.225207 23287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:10.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.225329 23287 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:10.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.225402 23287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:10.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.264480 23287 rpc_server.cc:307] RPC server started. Bound to: 127.22.85.66:43671
05:52:10.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.264503 23414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.85.66:43671 every 8 connection(s)
05:52:10.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.265793 23287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/data/info.pb
05:52:10.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.275022 22869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23287
05:52:10.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.275197 22869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-1/wal/instance
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.280140 22869 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:10.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/logs
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data/info.pb
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.67:0
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.85.67
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.67
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:10.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:10.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.284559 23416 heartbeater.cc:347] Connected to a master server at 127.22.85.126:44565
05:52:10.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.284595 23415 heartbeater.cc:347] Connected to a master server at 127.22.85.124:45561
05:52:10.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.284958 23415 heartbeater.cc:464] Registering TS with master...
05:52:10.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.284966 23416 heartbeater.cc:464] Registering TS with master...
05:52:10.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.286157 23415 heartbeater.cc:511] Master 127.22.85.124:45561 requested a full tablet report, sending...
05:52:10.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.286180 23416 heartbeater.cc:511] Master 127.22.85.126:44565 requested a full tablet report, sending...
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.287186 23417 heartbeater.cc:347] Connected to a master server at 127.22.85.125:38831
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.287302 23417 heartbeater.cc:464] Registering TS with master...
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.287705 22910 ts_manager.cc:194] Registered new tserver with Master: 74282ab72dbf4ab2a135a48bf201d86e (127.22.85.66:43671)
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.287726 23417 heartbeater.cc:511] Master 127.22.85.125:38831 requested a full tablet report, sending...
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.287863 23053 ts_manager.cc:194] Registered new tserver with Master: 74282ab72dbf4ab2a135a48bf201d86e (127.22.85.66:43671)
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.288727 22982 ts_manager.cc:194] Registered new tserver with Master: 74282ab72dbf4ab2a135a48bf201d86e (127.22.85.66:43671)
05:52:10.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.288765 22910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.85.66:43253
05:52:10.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.607463 23422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:10.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.607827 23422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:10.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.607947 23422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:10.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.615337 23422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:10.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.615589 23422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.85.67
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.624229 23422 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.85.84:41303
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.85.67:0
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data/info.pb
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.85.67
05:52:10.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.85.126:44565,127.22.85.125:38831,127.22.85.124:45561
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.85.67
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/logs
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:10.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:10.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.625830 23422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:10.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.627606 23422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:10.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.640595 23427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:10.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.640632 23428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:10.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.641304 23430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:10.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.641620 23422 server_base.cc:1034] running on GCE node
05:52:10.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.642410 23422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:10.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.643491 23422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:10.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.644775 23422 hybrid_clock.cc:648] HybridClock initialized: now 1783489930644707 us; error 41 us; skew 500 ppm
05:52:10.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.645056 23422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:10.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.652314 23422 webserver.cc:460] Webserver started at http://127.22.85.67:39435/ using document root <none> and password file <none>
05:52:10.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.653105 23422 fs_manager.cc:359] Metadata directory not provided
05:52:10.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.653223 23422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:10.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.653489 23422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:10.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.656299 23422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data/instance:
05:52:10.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "baeb5393e0e843cc8c8cd682291fb1a7"
05:52:10.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:10 on dist-test-slave-fnnq"
05:52:10.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.657049 23422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal/instance:
05:52:10.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "baeb5393e0e843cc8c8cd682291fb1a7"
05:52:10.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:10 on dist-test-slave-fnnq"
05:52:10.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.662518 23422 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
05:52:10.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.666014 23436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.667343 23422 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.667475 23422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "baeb5393e0e843cc8c8cd682291fb1a7"
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:10 on dist-test-slave-fnnq"
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.667713 23422 fs_report.cc:383] FS layout report
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data/data
05:52:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:10.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:10.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.681874 23422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:10.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.682627 23422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:10.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.682857 23422 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:10.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.683825 23422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:10.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.685236 23422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:10.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.685312 23422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:10.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.685391 23422 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:10.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.685428 23422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:10.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.720052 23422 rpc_server.cc:307] RPC server started. Bound to: 127.22.85.67:42223
05:52:10.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.720145 23548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.85.67:42223 every 8 connection(s)
05:52:10.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.721211 23422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/data/info.pb
05:52:10.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.721812 22869 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23422
05:52:10.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.722069 22869 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster8996721552342712803/ts-2/wal/instance
05:52:10.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.741060 23551 heartbeater.cc:347] Connected to a master server at 127.22.85.125:38831
05:52:10.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.741479 23551 heartbeater.cc:464] Registering TS with master...
05:52:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.742393 23551 heartbeater.cc:511] Master 127.22.85.125:38831 requested a full tablet report, sending...
05:52:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.743464 23550 heartbeater.cc:347] Connected to a master server at 127.22.85.126:44565
05:52:10.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.743618 23550 heartbeater.cc:464] Registering TS with master...
05:52:10.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.743999 23550 heartbeater.cc:511] Master 127.22.85.126:44565 requested a full tablet report, sending...
05:52:10.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.744197 22982 ts_manager.cc:194] Registered new tserver with Master: baeb5393e0e843cc8c8cd682291fb1a7 (127.22.85.67:42223)
05:52:10.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.745127 22910 ts_manager.cc:194] Registered new tserver with Master: baeb5393e0e843cc8c8cd682291fb1a7 (127.22.85.67:42223)
05:52:10.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.746119 22910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.85.67:43785
05:52:10.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.749431 23549 heartbeater.cc:347] Connected to a master server at 127.22.85.124:45561
05:52:10.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.749577 23549 heartbeater.cc:464] Registering TS with master...
05:52:10.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.749948 23549 heartbeater.cc:511] Master 127.22.85.124:45561 requested a full tablet report, sending...
05:52:10.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.751518 23053 ts_manager.cc:194] Registered new tserver with Master: baeb5393e0e843cc8c8cd682291fb1a7 (127.22.85.67:42223)
05:52:10.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.767706 22869 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
05:52:10.769 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:52:10.770 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

05:52:10.773 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.22.85.126"
      port: 44565
    }
    bound_http_address {
      host: "127.22.85.126"
      port: 35037
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.22.85.125"
      port: 38831
    }
    bound_http_address {
      host: "127.22.85.125"
      port: 43035
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.22.85.124"
      port: 45561
    }
    bound_http_address {
      host: "127.22.85.124"
      port: 33711
    }
  }
}

05:52:10.773 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

05:52:10.776 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.22.85.65"
      port: 43179
    }
    bound_http_address {
      host: "127.22.85.65"
      port: 35291
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.22.85.66"
      port: 43671
    }
    bound_http_address {
      host: "127.22.85.66"
      port: 40105
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.22.85.67"
      port: 42223
    }
    bound_http_address {
      host: "127.22.85.67"
      port: 39435
    }
  }
}

05:52:10.776 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
05:52:10.778 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:52:10.780 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:52:10.782 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.85.124:45561(127.22.85.124:45561)] connecting to peer
05:52:10.784 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.85.125:38831(127.22.85.125:38831)] connecting to peer
05:52:10.785 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:10.788 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.85.125:38831(127.22.85.125:38831)] Successfully connected to peer
05:52:10.788 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.85.124:45561(127.22.85.124:45561)] Successfully connected to peer
05:52:10.791 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.85.126:44565(127.22.85.126:44565)] Successfully connected to peer
05:52:10.791 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.85.125
05:52:10.795 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.85.124
05:52:10.802 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.22.85.126
05:52:10.828 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb85f654b, L:/127.0.0.1:44128 - R:/127.22.85.125:38831] using SASL/PLAIN
05:52:10.835 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x4914fd37, L:/127.0.0.1:47384 - R:/127.22.85.124:45561] using SASL/PLAIN
05:52:10.839 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x76edb8a8, L:/127.0.0.1:53094 - R:/127.22.85.126:44565] using SASL/PLAIN
05:52:10.842 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:52:10.842 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=61), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [49ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [60ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: OK, deferred=null) after lookup
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.845073 22910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53094:
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=SCAN_TABLE"
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:10.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
05:52:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:52:10.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:10.847218 22910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=SCAN_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
05:52:10.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.854158 23278 heartbeater.cc:503] Master 127.22.85.126:44565 was elected leader, sending a full tablet report...
05:52:10.864 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 7563f60d62af4400b83daa928f33b3c2
05:52:10.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.910604 23350 tablet_service.cc:1467] Processing CreateTablet for tablet 53b94e6981684a13af1702c84b230f78 (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=7563f60d62af4400b83daa928f33b3c2]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:10.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.912982 23350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53b94e6981684a13af1702c84b230f78. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.917198 23212 tablet_service.cc:1467] Processing CreateTablet for tablet 53b94e6981684a13af1702c84b230f78 (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=7563f60d62af4400b83daa928f33b3c2]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.918496 23212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53b94e6981684a13af1702c84b230f78. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:10.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.949945 23577 tablet_bootstrap.cc:492] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: Bootstrap starting.
05:52:10.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.953649 23484 tablet_service.cc:1467] Processing CreateTablet for tablet 53b94e6981684a13af1702c84b230f78 (DEFAULT_TABLE table=TestMasterFailover-killBefore=SCAN_TABLE [id=7563f60d62af4400b83daa928f33b3c2]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:10.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.954895 23577 tablet_bootstrap.cc:654] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: Neither blocks nor log segments found. Creating new log.
05:52:10.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.955385 23484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53b94e6981684a13af1702c84b230f78. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:10.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.956372 23577 log.cc:824] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: Log is configured to *not* fsync() on all Append() calls
05:52:10.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.957294 23578 tablet_bootstrap.cc:492] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: Bootstrap starting.
05:52:10.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.961004 23578 tablet_bootstrap.cc:654] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: Neither blocks nor log segments found. Creating new log.
05:52:10.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.961511 23577 tablet_bootstrap.cc:492] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: No bootstrap required, opened a new log
05:52:10.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.961833 23577 ts_tablet_manager.cc:1397] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.000s
05:52:10.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.962244 23578 log.cc:824] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: Log is configured to *not* fsync() on all Append() calls
05:52:10.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.970992 23577 raft_consensus.cc:348] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:10.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.971603 23577 raft_consensus.cc:374] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:10.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.971819 23577 raft_consensus.cc:729] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74282ab72dbf4ab2a135a48bf201d86e, State: Initialized, Role: FOLLOWER
05:52:10.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.972419 23581 tablet_bootstrap.cc:492] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: Bootstrap starting.
05:52:10.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.972885 23577 consensus_queue.cc:260] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:10.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.973974 23578 tablet_bootstrap.cc:492] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: No bootstrap required, opened a new log
05:52:10.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.974404 23578 ts_tablet_manager.cc:1397] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
05:52:10.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.975009 23577 ts_tablet_manager.cc:1428] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
05:52:10.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.976171 23416 heartbeater.cc:503] Master 127.22.85.126:44565 was elected leader, sending a full tablet report...
05:52:10.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.976720 23581 tablet_bootstrap.cc:654] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: Neither blocks nor log segments found. Creating new log.
05:52:10.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.978075 23581 log.cc:824] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: Log is configured to *not* fsync() on all Append() calls
05:52:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.983852 23581 tablet_bootstrap.cc:492] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: No bootstrap required, opened a new log
05:52:10.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.984683 23581 ts_tablet_manager.cc:1397] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
05:52:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.984628 23578 raft_consensus.cc:348] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.985019 23578 raft_consensus.cc:374] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:10.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.985143 23578 raft_consensus.cc:729] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99808c349a124ee1aca09d4e96dbef10, State: Initialized, Role: FOLLOWER
05:52:10.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.985777 23578 consensus_queue.cc:260] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:10.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.989194 23578 ts_tablet_manager.cc:1428] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
05:52:10.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.995242 23581 raft_consensus.cc:348] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:10.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.995719 23581 raft_consensus.cc:374] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:10.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.995836 23581 raft_consensus.cc:729] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baeb5393e0e843cc8c8cd682291fb1a7, State: Initialized, Role: FOLLOWER
05:52:10.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.996454 23581 consensus_queue.cc:260] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:10.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.997609 23550 heartbeater.cc:503] Master 127.22.85.126:44565 was elected leader, sending a full tablet report...
05:52:10.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:10.998402 23581 ts_tablet_manager.cc:1428] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.007s
05:52:11.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:11.020375 23418 tablet.cc:2369] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:11.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:11.048837 23280 tablet.cc:2369] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:11.227048 23552 tablet.cc:2369] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:11.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.418344 23582 raft_consensus.cc:482] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:11.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.418665 23582 raft_consensus.cc:504] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:11.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.420351 23582 leader_election.cc:288] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baeb5393e0e843cc8c8cd682291fb1a7 (127.22.85.67:42223), 99808c349a124ee1aca09d4e96dbef10 (127.22.85.65:43179)
05:52:11.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.429267 23232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53b94e6981684a13af1702c84b230f78" candidate_uuid: "74282ab72dbf4ab2a135a48bf201d86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99808c349a124ee1aca09d4e96dbef10" is_pre_election: true
05:52:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.429859 23232 raft_consensus.cc:2454] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74282ab72dbf4ab2a135a48bf201d86e in term 0.
05:52:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.430215 23504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53b94e6981684a13af1702c84b230f78" candidate_uuid: "74282ab72dbf4ab2a135a48bf201d86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" is_pre_election: true
05:52:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.430588 23303 leader_election.cc:302] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74282ab72dbf4ab2a135a48bf201d86e, 99808c349a124ee1aca09d4e96dbef10; no voters: 
05:52:11.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.430707 23504 raft_consensus.cc:2454] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74282ab72dbf4ab2a135a48bf201d86e in term 0.
05:52:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.431085 23582 raft_consensus.cc:2781] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.431279 23582 raft_consensus.cc:482] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:11.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.431401 23582 raft_consensus.cc:3037] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 0 FOLLOWER]: Advancing to term 1
05:52:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.433375 23582 raft_consensus.cc:504] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.434019 23582 leader_election.cc:288] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [CANDIDATE]: Term 1 election: Requested vote from peers baeb5393e0e843cc8c8cd682291fb1a7 (127.22.85.67:42223), 99808c349a124ee1aca09d4e96dbef10 (127.22.85.65:43179)
05:52:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.434402 23504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53b94e6981684a13af1702c84b230f78" candidate_uuid: "74282ab72dbf4ab2a135a48bf201d86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baeb5393e0e843cc8c8cd682291fb1a7"
05:52:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.434520 23232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53b94e6981684a13af1702c84b230f78" candidate_uuid: "74282ab72dbf4ab2a135a48bf201d86e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99808c349a124ee1aca09d4e96dbef10"
05:52:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.434623 23504 raft_consensus.cc:3037] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [term 0 FOLLOWER]: Advancing to term 1
05:52:11.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.434670 23232 raft_consensus.cc:3037] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [term 0 FOLLOWER]: Advancing to term 1
05:52:11.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.436980 23232 raft_consensus.cc:2454] T 53b94e6981684a13af1702c84b230f78 P 99808c349a124ee1aca09d4e96dbef10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74282ab72dbf4ab2a135a48bf201d86e in term 1.
05:52:11.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.437038 23504 raft_consensus.cc:2454] T 53b94e6981684a13af1702c84b230f78 P baeb5393e0e843cc8c8cd682291fb1a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74282ab72dbf4ab2a135a48bf201d86e in term 1.
05:52:11.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.437391 23303 leader_election.cc:302] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74282ab72dbf4ab2a135a48bf201d86e, 99808c349a124ee1aca09d4e96dbef10; no voters: 
05:52:11.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.437724 23582 raft_consensus.cc:2781] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 1 FOLLOWER]: Leader election won for term 1
05:52:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.438292 23582 raft_consensus.cc:686] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [term 1 LEADER]: Becoming Leader. State: Replica: 74282ab72dbf4ab2a135a48bf201d86e, State: Running, Role: LEADER
05:52:11.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.438822 23582 consensus_queue.cc:237] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } }
05:52:11.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.444355 22910 catalog_manager.cc:5495] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e reported cstate change: term changed from 0 to 1, leader changed from <none> to 74282ab72dbf4ab2a135a48bf201d86e (127.22.85.66). New cstate: current_term: 1 leader_uuid: "74282ab72dbf4ab2a135a48bf201d86e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74282ab72dbf4ab2a135a48bf201d86e" member_type: VOTER last_known_addr { host: "127.22.85.66" port: 43671 } health_report { overall_health: HEALTHY } } }
05:52:11.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.867369 23582 consensus_queue.cc:1035] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "99808c349a124ee1aca09d4e96dbef10" member_type: VOTER last_known_addr { host: "127.22.85.65" port: 43179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:11.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:11.881270 23604 consensus_queue.cc:1035] T 53b94e6981684a13af1702c84b230f78 P 74282ab72dbf4ab2a135a48bf201d86e [LEADER]: Connected to new peer: Peer: permanent_uuid: "baeb5393e0e843cc8c8cd682291fb1a7" member_type: VOTER last_known_addr { host: "127.22.85.67" port: 42223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:12.307 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 7563f60d62af4400b83daa928f33b3c2
05:52:12.308 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.22.85.126:44565
05:52:12.308 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

05:52:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:12.309613 22869 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22880
05:52:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:12.311136 22941 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:12.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:12.420964 22869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22880
05:52:12.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:12.440987 23416 heartbeater.cc:644] Failed to heartbeat to 127.22.85.126:44565 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.22.85.126:44565 (error 108)
05:52:12.441 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.85.126:44565(127.22.85.126:44565)] handling channelInactive
05:52:12.441 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state READY due to: connection closed
05:52:12.441 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
05:52:12.442 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.444 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.444 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.444 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.22.85.126:44565(127.22.85.126:44565) for tablet Kudu Master: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.463 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.466 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.466 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.466 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.467 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.483 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.485 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.486 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.486 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.486 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.502 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.505 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.506 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.506 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.506 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.523 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.525 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.525 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.525 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.525 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.542 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.544 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.545 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.545 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.545 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.583 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.584 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.584 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.584 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.585 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.703 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.704 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.704 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.704 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.705 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.744 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:12.746 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.746 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.746 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:12.747 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:12.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:12.880028 23278 heartbeater.cc:644] Failed to heartbeat to 127.22.85.126:44565 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111)
05:52:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:12.891697 23550 heartbeater.cc:644] Failed to heartbeat to 127.22.85.126:44565 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111)
05:52:13.083 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:13.084 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:13.085 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:13.085 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:13.086 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:13.183 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:13.184 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:13.184 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:13.184 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:13.185 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565; will retry
05:52:13.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.545634 23615 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35f6a641277f4afb91282acb7ac4808e)
05:52:13.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.545946 23615 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:13.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.547359 23615 leader_election.cc:288] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565), 9100bdb9143441d0920f646bd3893d22 (127.22.85.124:45561)
05:52:13.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.548134 23062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "9100bdb9143441d0920f646bd3893d22" is_pre_election: true
05:52:13.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:13.548260 22966 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111) [suppressed 4 similar messages]
05:52:13.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:13.549643 22966 leader_election.cc:334] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565): Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111)
05:52:13.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.549774 22966 leader_election.cc:302] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bf54b0fc7f4b4b91afc81d235532e1; no voters: 35f6a641277f4afb91282acb7ac4808e, 9100bdb9143441d0920f646bd3893d22
05:52:13.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.550098 23615 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
05:52:13.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.555629 23618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35f6a641277f4afb91282acb7ac4808e)
05:52:13.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.555809 23618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:13.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.556989 23618 leader_election.cc:288] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565), 48bf54b0fc7f4b4b91afc81d235532e1 (127.22.85.125:38831)
05:52:13.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.557582 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9100bdb9143441d0920f646bd3893d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" is_pre_election: true
05:52:13.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.557840 22991 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9100bdb9143441d0920f646bd3893d22 in term 1.
05:52:13.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:13.557926 23037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111)
05:52:13.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.558482 23039 leader_election.cc:302] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bf54b0fc7f4b4b91afc81d235532e1, 9100bdb9143441d0920f646bd3893d22; no voters: 
05:52:13.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.558960 23618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Leader pre-election won for term 2
05:52:13.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.559140 23618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35f6a641277f4afb91282acb7ac4808e)
05:52:13.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.559260 23618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 1 FOLLOWER]: Advancing to term 2
05:52:13.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:13.559820 23037 leader_election.cc:334] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565): Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111)
05:52:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.561952 23618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:13.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.562469 23618 leader_election.cc:288] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [CANDIDATE]: Term 2 election: Requested vote from peers 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565), 48bf54b0fc7f4b4b91afc81d235532e1 (127.22.85.125:38831)
05:52:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.563061 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9100bdb9143441d0920f646bd3893d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "48bf54b0fc7f4b4b91afc81d235532e1"
05:52:13.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.563333 22991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 1 FOLLOWER]: Advancing to term 2
05:52:13.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:13.563874 23037 leader_election.cc:334] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565): Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111)
05:52:13.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.565621 22991 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9100bdb9143441d0920f646bd3893d22 in term 2.
05:52:13.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.566078 23039 leader_election.cc:302] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bf54b0fc7f4b4b91afc81d235532e1, 9100bdb9143441d0920f646bd3893d22; no voters: 35f6a641277f4afb91282acb7ac4808e
05:52:13.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.566409 23618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 2 FOLLOWER]: Leader election won for term 2
05:52:13.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.566781 23618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [term 2 LEADER]: Becoming Leader. State: Replica: 9100bdb9143441d0920f646bd3893d22, State: Running, Role: LEADER
05:52:13.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.567209 23618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } }
05:52:13.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.568877 23621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9100bdb9143441d0920f646bd3893d22. Latest consensus state: current_term: 2 leader_uuid: "9100bdb9143441d0920f646bd3893d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:13.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.569262 23621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: This master's current role is: LEADER
05:52:13.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.569865 23623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:52:13.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.572223 23623 catalog_manager.cc:669] Loaded metadata for table TestMasterFailover-killBefore=SCAN_TABLE [id=7563f60d62af4400b83daa928f33b3c2]
05:52:13.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.573802 23623 tablet_loader.cc:96] loaded metadata for tablet 53b94e6981684a13af1702c84b230f78 (table TestMasterFailover-killBefore=SCAN_TABLE [id=7563f60d62af4400b83daa928f33b3c2])
05:52:13.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.574108 23623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:52:13.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.574909 23623 catalog_manager.cc:1259] Loaded cluster ID: 7c6aab56c9cf409497ac376efada43ed
05:52:13.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.575013 23623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:52:13.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.576236 23623 catalog_manager.cc:1504] Loading token signing keys...
05:52:13.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.577057 23623 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22: Loaded TSK: 0
05:52:13.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.577886 23623 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:52:13.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.828210 23019 master_runner.cc:186] Error getting master registration for 127.22.85.126:44565: Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111), 
05:52:13.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:13.828454 23019 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:14.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:14.022217 23037 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 -> Peer 35f6a641277f4afb91282acb7ac4808e (127.22.85.126:44565): Couldn't send request to peer 35f6a641277f4afb91282acb7ac4808e. Status: Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
05:52:14.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.069128 22950 master_runner.cc:186] Error getting master registration for 127.22.85.126:44565: Network error: Client connection negotiation failed: client connection to 127.22.85.126:44565: connect: Connection refused (error 111), 
05:52:14.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.075791 22950 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:14.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.190065 22991 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [term 2 FOLLOWER]: Refusing update from remote peer 9100bdb9143441d0920f646bd3893d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
05:52:14.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.190829 23621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
05:52:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.192796 23627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9100bdb9143441d0920f646bd3893d22. Latest consensus state: current_term: 2 leader_uuid: "9100bdb9143441d0920f646bd3893d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.193068 23627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:14.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.194761 23629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9100bdb9143441d0920f646bd3893d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:14.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.195294 23627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9100bdb9143441d0920f646bd3893d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35f6a641277f4afb91282acb7ac4808e" member_type: VOTER last_known_addr { host: "127.22.85.126" port: 44565 } } peers { permanent_uuid: "48bf54b0fc7f4b4b91afc81d235532e1" member_type: VOTER last_known_addr { host: "127.22.85.125" port: 38831 } } peers { permanent_uuid: "9100bdb9143441d0920f646bd3893d22" member_type: VOTER last_known_addr { host: "127.22.85.124" port: 45561 } } }
05:52:14.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.195489 23627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48bf54b0fc7f4b4b91afc81d235532e1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:14.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.195734 23629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9100bdb9143441d0920f646bd3893d22 [sys.catalog]: This master's current role is: LEADER
05:52:14.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.882385 23277 heartbeater.cc:503] Master 127.22.85.124:45561 was elected leader, sending a full tablet report...
05:52:14.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:14.893886 23549 heartbeater.cc:503] Master 127.22.85.124:45561 was elected leader, sending a full tablet report...
05:52:15.242 [DEBUG - pool-12-thread-1] (Connection.java:748) [peer master-127.22.85.126:44565(127.22.85.126:44565)] connecting to peer
05:52:15.243 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:15.244 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.126:44565(127.22.85.126:44565)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:15.244 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.85.126:44565: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565
05:52:15.246 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:52:15.247 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=30000, elapsed=2804), Traces: [0ms] sending RPC to server master-127.22.85.126:44565, [2ms] received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [2ms] delaying RPC due to: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [23ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [25ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [43ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [44ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [62ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [64ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [83ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [99ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [103ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [143ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [143ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [262ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [262ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [263ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [263ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [303ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [304ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [305ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [640ms] refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [643ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [643ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [643ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [644ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [740ms] refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [742ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [742ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [743ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [743ms] delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [2800ms] refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, deferred=Deferred@1479229816(state=PENDING, result=null, callback=get tablet locations from the master for table TestMasterFailover-killBefore=SCAN_TABLE -> release master lookup permit -> retry RPC -> scanner opened -> passthrough -> org.apache.kudu.test.ClientTestUtil$2@48738ab7 -> wakeup thread Time-limited test -> (continuation of Deferred@1409923468 after retry RPC after error@1338806742) -> (continuation of Deferred@1299065302 after retry RPC after error@421278974) -> (continuation of Deferred@4205448 after retry RPC after error@732518519) -> (continuation of Deferred@397796429 after retry RPC after error@1878432129) -> (continuation of Deferred@1852568476 after retry RPC after error@257979590) -> (continuation of Deferred@927952619 after retry RPC after error@1815008018) -> (continuation of Deferred@1575496216 after retry RPC after error@1361228583) -> (continuation of Deferred@500606942 after retry RPC after error@133845301) -> (continuation of Deferred@467538744 after retry RPC after error@1604395247) -> (continuation of Deferred@2011268242 after retry RPC after error@583467170), errback=passthrough -> release master lookup permit -> retry RPC after error -> passthrough -> open scanner errback -> org.apache.kudu.test.ClientTestUtil$1@496b9011 -> wakeup thread Time-limited test -> (continuation of Deferred@1409923468 after retry RPC after error@1338806742) -> (continuation of Deferred@1299065302 after retry RPC after error@421278974) -> (continuation of Deferred@4205448 after retry RPC after error@732518519) -> (continuation of Deferred@397796429 after retry RPC after error@1878432129) -> (continuation of Deferred@1852568476 after retry RPC after error@257979590) -> (continuation of Deferred@927952619 after retry RPC after error@1815008018) -> (continuation of Deferred@1575496216 after retry RPC after error@1361228583) -> (continuation of Deferred@500606942 after retry RPC after error@133845301) -> (continuation of Deferred@467538744 after retry RPC after error@1604395247) -> (continuation of Deferred@2011268242 after retry RPC after error@583467170))) after lookup
05:52:15.250 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 53b94e6981684a13af1702c84b230f78 for table 'TestMasterFailover-killBefore=SCAN_TABLE' with partition [<start>, <end>)
05:52:15.251 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=53b94e6981684a13af1702c84b230f78@[74282ab72dbf4ab2a135a48bf201d86e(127.22.85.66:43671)[L],99808c349a124ee1aca09d4e96dbef10(127.22.85.65:43179),baeb5393e0e843cc8c8cd682291fb1a7(127.22.85.67:42223)]}]
05:52:15.252 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=2809), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.22.85.126:44565, [2ms] Sub RPC GetTableLocations: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [2ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [20ms] Sub RPC GetTableLocations: refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [23ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [40ms] Sub RPC GetTableLocations: refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [43ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [44ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [62ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [64ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [80ms] Sub RPC GetTableLocations: refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [82ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [83ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [99ms] Sub RPC GetTableLocations: refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [102ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [103ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [103ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [140ms] Sub RPC GetTableLocations: refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [142ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [143ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [143ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [260ms] Sub RPC GetTableLocations: refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [262ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [262ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [263ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [263ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [300ms] Sub RPC GetTableLocations: refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [303ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [304ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [304ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [305ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [640ms] Sub RPC GetTableLocations: refreshing cache from master, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [641ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [643ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [643ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [643ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [644ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [740ms] Sub RPC GetTableLocations: refreshing cache from master, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [742ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [742ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [743ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [743ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.85.124:45561,127.22.85.125:38831,127.22.85.126:44565) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [2800ms] Sub RPC GetTableLocations: refreshing cache from master, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.124:45561, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.125:38831, [2800ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.85.126:44565, [2802ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.126:44565: Network error: Failed to connect to peer master-127.22.85.126:44565(127.22.85.126:44565): Connection refused: /127.22.85.126:44565, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.125:38831: OK, [2803ms] Sub RPC ConnectToMaster: received response from server master-127.22.85.124:45561: OK, [2806ms] Sub RPC GetTableLocations: sending RPC to server master-127.22.85.124:45561, [2808ms] Sub RPC GetTableLocations: received response from server master-127.22.85.124:45561: OK, deferred=null)) after lookup
05:52:15.253 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 74282ab72dbf4ab2a135a48bf201d86e(127.22.85.66:43671)] connecting to peer
05:52:15.254 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 74282ab72dbf4ab2a135a48bf201d86e(127.22.85.66:43671)] Successfully connected to peer
05:52:15.274 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x80d9ef3f, L:/127.0.0.1:59580 - R:/127.22.85.66:43671] using TOKEN/null
05:52:15.281 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=SCAN_TABLE, tablet=53b94e6981684a13af1702c84b230f78, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
05:52:15.281 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:52:15.284 [DEBUG - main] (Connection.java:575) [peer master-127.22.85.124:45561(127.22.85.124:45561)] disconnecting while in state READY
05:52:15.284 [DEBUG - main] (Connection.java:575) [peer master-127.22.85.126:44565(127.22.85.126:44565)] disconnecting while in state TERMINATED
05:52:15.284 [DEBUG - main] (Connection.java:575) [peer master-127.22.85.125:38831(127.22.85.125:38831)] disconnecting while in state READY
05:52:15.284 [DEBUG - main] (Connection.java:575) [peer 74282ab72dbf4ab2a135a48bf201d86e(127.22.85.66:43671)] disconnecting while in state READY
05:52:15.285 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.85.124:45561(127.22.85.124:45561)] handling channelInactive
05:52:15.285 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.85.124:45561(127.22.85.124:45561)] cleaning up while in state READY due to: connection closed
05:52:15.288 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:52:15.288 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.85.125:38831(127.22.85.125:38831)] handling channelInactive
05:52:15.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.288981 22869 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23150
05:52:15.289 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.85.125:38831(127.22.85.125:38831)] cleaning up while in state READY due to: connection closed
05:52:15.290 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 74282ab72dbf4ab2a135a48bf201d86e(127.22.85.66:43671)] handling channelInactive
05:52:15.290 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 74282ab72dbf4ab2a135a48bf201d86e(127.22.85.66:43671)] cleaning up while in state READY due to: connection closed
05:52:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.304064 23272 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:15.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.397475 23415 heartbeater.cc:503] Master 127.22.85.124:45561 was elected leader, sending a full tablet report...
05:52:15.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.470644 22869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23150
05:52:15.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.488292 22869 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23287
05:52:15.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.496068 23410 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:15.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.623126 22869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23287
05:52:15.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.640802 22869 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23422
05:52:15.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.648026 23544 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:15.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.736800 22869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23422
05:52:15.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.754051 22869 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 22950
05:52:15.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.755227 23012 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:15.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.861619 22869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 22950
05:52:15.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.881163 22869 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23019
05:52:15.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.882242 23083 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:15.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:15.989015 22869 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23019
05:52:16.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:16Z chronyd exiting
.05:52:16.146 [INFO - main] (RandomUtils.java:49) Using random seed: 1783489936146
05:52:16.148 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
05:52:16.148 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
05:52:16.149 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskAojDjo/test-tmp
05:52:16.149 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
05:52:16.149 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskAojDjo/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
05:52:16.150 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

05:52:16.459 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:52:16.460 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

05:52:16.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.462363 23655 mini_oidc.cc:152] Starting JWKS server
05:52:16.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.465471 23655 webserver.cc:460] Webserver started at http://127.0.0.1:33479/ using document root <none> and password file <none>
05:52:16.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.465719 23655 mini_oidc.cc:189] Starting OIDC Discovery server
05:52:16.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.466378 23655 webserver.cc:460] Webserver started at http://127.0.0.1:42633/ using document root <none> and password file <none>
05:52:16.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
05:52:16.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:16Z Disabled control of system clock
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.495488 23655 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:16.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/logs
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data/info.pb
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.254:39525
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.254
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:16.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33479/jwks.json with env {}
05:52:16.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.803797 23666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:16.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.804142 23666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:16.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.804263 23666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.811576 23666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:52:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.811724 23666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.811790 23666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:52:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.811861 23666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:52:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.811919 23666 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:52:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.811996 23666 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:33479/jwks.json
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.821053 23666 master_runner.cc:386] Master server non-default flags:
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.254:39525
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33479/jwks.json
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data/info.pb
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.254
05:52:16.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/logs
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:16.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.822695 23666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:16.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.824810 23666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:16.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.837380 23674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:16.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.837423 23672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:16.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.837491 23666 server_base.cc:1034] running on GCE node
05:52:16.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.837380 23671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:16.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.838770 23666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:16.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.840250 23666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.841517 23666 hybrid_clock.cc:648] HybridClock initialized: now 1783489936841435 us; error 35 us; skew 500 ppm
05:52:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.841867 23666 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:16.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.847738 23666 webserver.cc:460] Webserver started at http://127.23.25.254:38681/ using document root <none> and password file <none>
05:52:16.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.848423 23666 fs_manager.cc:359] Metadata directory not provided
05:52:16.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.848578 23666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:16.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.848889 23666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.851590 23666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data/instance:
05:52:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01"
05:52:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:16 on dist-test-slave-fnnq"
05:52:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.852421 23666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal/instance:
05:52:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01"
05:52:16.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:16 on dist-test-slave-fnnq"
05:52:16.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.857481 23666 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
05:52:16.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.860925 23680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:16.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.862160 23666 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
05:52:16.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.862345 23666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal
05:52:16.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01"
05:52:16.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:16 on dist-test-slave-fnnq"
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.862573 23666 fs_report.cc:383] FS layout report
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data/data
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:16.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:16.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.882503 23666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:16.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.883397 23666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:16.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.883783 23666 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:16.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.904156 23666 rpc_server.cc:307] RPC server started. Bound to: 127.23.25.254:39525
05:52:16.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.904204 23731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.25.254:39525 every 8 connection(s)
05:52:16.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.905540 23666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/data/info.pb
05:52:16.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.909672 23655 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23666
05:52:16.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.909842 23732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:16.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.909946 23655 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-0/wal/instance
05:52:16.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.912770 23655 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:16.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/logs
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data/info.pb
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.253:38185
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.253
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33479/jwks.json with env {}
05:52:16.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.918476 23732 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } has no permanent_uuid. Determining permanent_uuid...
05:52:16.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.935360 23732 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } has no permanent_uuid. Determining permanent_uuid...
05:52:16.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.936533 23681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.25.253:38185: connect: Connection refused (error 111)
05:52:16.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.938083 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.253:38185: Network error: Client connection negotiation failed: client connection to 127.23.25.253:38185: connect: Connection refused (error 111)
05:52:16.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:16.987429 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } attempt: 1
05:52:16.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:16.989557 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.253:38185: Network error: Client connection negotiation failed: client connection to 127.23.25.253:38185: connect: Connection refused (error 111)
05:52:17.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.057823 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } attempt: 2
05:52:17.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.060010 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.253:38185: Network error: Client connection negotiation failed: client connection to 127.23.25.253:38185: connect: Connection refused (error 111)
05:52:17.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.151266 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } attempt: 3
05:52:17.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.153244 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.253:38185: Network error: Client connection negotiation failed: client connection to 127.23.25.253:38185: connect: Connection refused (error 111)
05:52:17.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.227065 23734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:17.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.227398 23734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:17.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.227519 23734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.235453 23734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:52:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.235623 23734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.235687 23734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:52:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.235764 23734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:52:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.235823 23734 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:52:17.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.235900 23734 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:33479/jwks.json
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.244894 23734 master_runner.cc:386] Master server non-default flags:
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.253:38185
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33479/jwks.json
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data/info.pb
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.253
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/logs
05:52:17.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:17.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.246564 23734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:17.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.248436 23734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:17.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.260116 23742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:17.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.260176 23743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:17.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.260116 23745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:17.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.261242 23734 server_base.cc:1034] running on GCE node
05:52:17.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.262115 23734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:17.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.263477 23734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:17.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.264735 23734 hybrid_clock.cc:648] HybridClock initialized: now 1783489937264672 us; error 30 us; skew 500 ppm
05:52:17.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.265085 23734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:17.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.267653 23734 webserver.cc:460] Webserver started at http://127.23.25.253:34375/ using document root <none> and password file <none>
05:52:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.268352 23734 fs_manager.cc:359] Metadata directory not provided
05:52:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.268499 23734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.268780 23734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:17.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.272048 23734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data/instance:
05:52:17.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3a28297a49194d9a85fe05056c0c9e07"
05:52:17.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:17 on dist-test-slave-fnnq"
05:52:17.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.272857 23734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal/instance:
05:52:17.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3a28297a49194d9a85fe05056c0c9e07"
05:52:17.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:17 on dist-test-slave-fnnq"
05:52:17.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.277868 23734 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
05:52:17.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.281273 23751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:17.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.282583 23734 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
05:52:17.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.282716 23734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal
05:52:17.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3a28297a49194d9a85fe05056c0c9e07"
05:52:17.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:17 on dist-test-slave-fnnq"
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.282878 23734 fs_report.cc:383] FS layout report
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data/data
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:17.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.294374 23734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:17.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.295070 23734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:17.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.295379 23734 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:17.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.296491 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } attempt: 4
05:52:17.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.298570 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.253:38185: Network error: Client connection negotiation failed: client connection to 127.23.25.253:38185: connect: Connection refused (error 111)
05:52:17.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.313138 23734 rpc_server.cc:307] RPC server started. Bound to: 127.23.25.253:38185
05:52:17.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.313174 23802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.25.253:38185 every 8 connection(s)
05:52:17.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.314316 23734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/data/info.pb
05:52:17.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.317916 23803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:17.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.319195 23655 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23734
05:52:17.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.319366 23655 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-1/wal/instance
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.320597 23655 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/logs
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data/info.pb
05:52:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.252:36533
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.252
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33479/jwks.json with env {}
05:52:17.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.326190 23803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.340840 23803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.350178 23803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.351363 23754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.353041 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.402387 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 1
05:52:17.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.404533 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.472788 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 2
05:52:17.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.474910 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.566224 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 3
05:52:17.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.568369 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.597819 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } attempt: 5
05:52:17.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.604807 23732 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.606775 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.642379 23805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:17.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.642647 23805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:17.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.642726 23805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.649818 23805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
05:52:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.649924 23805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.649969 23805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
05:52:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.650017 23805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
05:52:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.650054 23805 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
05:52:17.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.650102 23805 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:33479/jwks.json
05:52:17.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.657999 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 1
05:52:17.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.659657 23805 master_runner.cc:386] Master server non-default flags:
05:52:17.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.252:36533
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33479/jwks.json
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data/info.pb
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.252
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/logs
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:17.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.659982 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.660965 23805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:17.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.662678 23805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:17.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.675272 23813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:17.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.675300 23816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:17.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.675392 23814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.681043 23805 server_base.cc:1034] running on GCE node
05:52:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.681813 23805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.683229 23805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:17.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.684478 23805 hybrid_clock.cc:648] HybridClock initialized: now 1783489937684384 us; error 65 us; skew 500 ppm
05:52:17.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.684777 23805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.687198 23805 webserver.cc:460] Webserver started at http://127.23.25.252:42333/ using document root <none> and password file <none>
05:52:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.687873 23805 fs_manager.cc:359] Metadata directory not provided
05:52:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.687971 23805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.688205 23805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:17.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.691668 23805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data/instance:
05:52:17.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a6f985e8f8314e5ea166292d5dcb5ae1"
05:52:17.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:17 on dist-test-slave-fnnq"
05:52:17.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.692591 23805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal/instance:
05:52:17.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a6f985e8f8314e5ea166292d5dcb5ae1"
05:52:17.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:17 on dist-test-slave-fnnq"
05:52:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.697468 23805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
05:52:17.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.700655 23822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:17.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.701838 23805 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.702018 23805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a6f985e8f8314e5ea166292d5dcb5ae1"
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:17 on dist-test-slave-fnnq"
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.702229 23805 fs_report.cc:383] FS layout report
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data/data
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:17.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:17.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.711622 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 4
05:52:17.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.713377 23803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.724466 23805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:17.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.725214 23805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:17.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.725557 23805 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:17.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.728188 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 2
05:52:17.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.729897 23732 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.23.25.252:36533: Network error: Client connection negotiation failed: client connection to 127.23.25.252:36533: connect: Connection refused (error 111)
05:52:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.744513 23805 rpc_server.cc:307] RPC server started. Bound to: 127.23.25.252:36533
05:52:17.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.744534 23873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.25.252:36533 every 8 connection(s)
05:52:17.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.745899 23805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/data/info.pb
05:52:17.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.746549 23655 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23805
05:52:17.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.746703 23655 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/master-2/wal/instance
05:52:17.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.750092 23874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:17.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.758337 23874 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.772920 23874 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.781320 23874 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } has no permanent_uuid. Determining permanent_uuid...
05:52:17.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.791911 23874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: Bootstrap starting.
05:52:17.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.794801 23874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: Neither blocks nor log segments found. Creating new log.
05:52:17.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.795818 23874 log.cc:824] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: Log is configured to *not* fsync() on all Append() calls
05:52:17.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.798519 23874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: No bootstrap required, opened a new log
05:52:17.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.805765 23874 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:17.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.806125 23874 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:17.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.806279 23874 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6f985e8f8314e5ea166292d5dcb5ae1, State: Initialized, Role: FOLLOWER
05:52:17.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.806847 23874 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:17.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.807644 23881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:17.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.807981 23881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:17.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.808535 23874 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: configured and running, proceeding with master startup.
05:52:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.817813 23892 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:52:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.817957 23892 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:17.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.815214 23805 master_runner.cc:186] Error getting master registration for 127.23.25.254:39525: OK, instance_id { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" instance_seqno: 1783489936898455 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:52:17.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.824093 23805 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.836122 23732 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 3
05:52:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.847337 23732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: Bootstrap starting.
05:52:17.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.850358 23732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: Neither blocks nor log segments found. Creating new log.
05:52:17.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.851313 23732 log.cc:824] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: Log is configured to *not* fsync() on all Append() calls
05:52:17.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.853756 23732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: No bootstrap required, opened a new log
05:52:17.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.861799 23732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:17.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.862048 23732 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:17.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.862193 23732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c05e49a0af94b2e9ba5a1fe790c7f01, State: Initialized, Role: FOLLOWER
05:52:17.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.862762 23732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:17.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.863655 23895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:17.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.864061 23895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: This master's current role is: FOLLOWER
05:52:17.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.864778 23732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: configured and running, proceeding with master startup.
05:52:17.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.875577 23906 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:52:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.875924 23906 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:17.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.873916 23666 master_runner.cc:186] Error getting master registration for 127.23.25.253:38185: OK, instance_id { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" instance_seqno: 1783489937308395 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
05:52:17.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:17.882387 23666 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:17.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.886425 23686 tablet.cc:2369] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:17.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:17.978029 23828 tablet.cc:2369] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.012599 23803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } attempt: 5
05:52:18.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.025121 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: Bootstrap starting.
05:52:18.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.029341 23803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: Neither blocks nor log segments found. Creating new log.
05:52:18.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.030678 23803 log.cc:824] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: Log is configured to *not* fsync() on all Append() calls
05:52:18.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.040303 23803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: No bootstrap required, opened a new log
05:52:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.051728 23803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.052126 23803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:18.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.052240 23803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a28297a49194d9a85fe05056c0c9e07, State: Initialized, Role: FOLLOWER
05:52:18.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.052901 23803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:18.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.053886 23909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.054414 23909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: This master's current role is: FOLLOWER
05:52:18.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.055223 23803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: configured and running, proceeding with master startup.
05:52:18.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.074348 23734 master_runner.cc:263] No leader master found from master 3a28297a49194d9a85fe05056c0c9e07
05:52:18.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.074503 23734 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:18.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.081512 23920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
05:52:18.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.081897 23920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
05:52:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.085292 23895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.085583 23895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.087210 23895 leader_election.cc:288] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a28297a49194d9a85fe05056c0c9e07 (127.23.25.253:38185), a6f985e8f8314e5ea166292d5dcb5ae1 (127.23.25.252:36533)
05:52:18.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.088644 23778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a28297a49194d9a85fe05056c0c9e07" is_pre_election: true
05:52:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.089258 23778 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c05e49a0af94b2e9ba5a1fe790c7f01 in term 0.
05:52:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.089915 23849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" is_pre_election: true
05:52:18.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.090476 23849 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c05e49a0af94b2e9ba5a1fe790c7f01 in term 0.
05:52:18.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.091482 23683 leader_election.cc:302] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c05e49a0af94b2e9ba5a1fe790c7f01, a6f985e8f8314e5ea166292d5dcb5ae1; no voters: 
05:52:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.092713 23895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.092864 23895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.092978 23895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 0 FOLLOWER]: Advancing to term 1
05:52:18.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.096204 23895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:18.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.098042 23849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1"
05:52:18.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.098251 23849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 0 FOLLOWER]: Advancing to term 1
05:52:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.100822 23778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a28297a49194d9a85fe05056c0c9e07"
05:52:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.101058 23778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 0 FOLLOWER]: Advancing to term 1
05:52:18.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.106912 23849 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c05e49a0af94b2e9ba5a1fe790c7f01 in term 1.
05:52:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.107728 23683 leader_election.cc:302] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c05e49a0af94b2e9ba5a1fe790c7f01, a6f985e8f8314e5ea166292d5dcb5ae1; no voters: 
05:52:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.108937 23778 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c05e49a0af94b2e9ba5a1fe790c7f01 in term 1.
05:52:18.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.111212 23895 leader_election.cc:288] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [CANDIDATE]: Term 1 election: Requested vote from peers 3a28297a49194d9a85fe05056c0c9e07 (127.23.25.253:38185), a6f985e8f8314e5ea166292d5dcb5ae1 (127.23.25.252:36533)
05:52:18.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.111755 23895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 1 FOLLOWER]: Leader election won for term 1
05:52:18.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.112392 23895 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [term 1 LEADER]: Becoming Leader. State: Replica: 8c05e49a0af94b2e9ba5a1fe790c7f01, State: Running, Role: LEADER
05:52:18.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.113345 23895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:18.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.130745 23922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c05e49a0af94b2e9ba5a1fe790c7f01. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.131405 23922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: This master's current role is: LEADER
05:52:18.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.138712 23924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:52:18.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.141426 23924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:52:18.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.161815 23849 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Refusing update from remote peer 8c05e49a0af94b2e9ba5a1fe790c7f01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:52:18.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.163053 23922 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:18.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.170652 23778 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Refusing update from remote peer 8c05e49a0af94b2e9ba5a1fe790c7f01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
05:52:18.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.171669 23922 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:18.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.209409 23909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c05e49a0af94b2e9ba5a1fe790c7f01. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.209759 23909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: This master's current role is: FOLLOWER
05:52:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.214380 23925 mvcc.cc:205] Tried to move back new op lower bound from 7305174786679877632 to 7305174786524188672. Current Snapshot: MvccSnapshot[applied={T|T < 7305174786679877632}]
05:52:18.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.216917 23881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c05e49a0af94b2e9ba5a1fe790c7f01. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.217262 23881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:18.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.218415 23927 mvcc.cc:205] Tried to move back new op lower bound from 7305174786679877632 to 7305174786524188672. Current Snapshot: MvccSnapshot[applied={T|T < 7305174786679877632}]
05:52:18.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.221287 23926 mvcc.cc:205] Tried to move back new op lower bound from 7305174786679877632 to 7305174786524188672. Current Snapshot: MvccSnapshot[applied={T|T < 7305174786679877632}]
05:52:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.223716 23909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.223955 23909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: This master's current role is: FOLLOWER
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.225997 23924 catalog_manager.cc:1347] Generated new cluster ID: 1ec07ef012d54b58a443ab9c940baac6
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.226097 23924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.227905 23922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.228145 23922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: This master's current role is: LEADER
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.228358 23922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.228523 23922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01 [sys.catalog]: This master's current role is: LEADER
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.231446 23881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:18.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.231689 23881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:18.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.277737 23924 catalog_manager.cc:1370] Generated new certificate authority record
05:52:18.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.279949 23924 catalog_manager.cc:1504] Loading token signing keys...
05:52:18.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.291967 23924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c05e49a0af94b2e9ba5a1fe790c7f01: Generated new TSK 0
05:52:18.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.293612 23924 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.313271 23655 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:18.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/logs
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data/info.pb
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.193:0
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.25.193
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.193
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:18.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:18.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.652508 23933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:18.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.652787 23933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:18.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.652889 23933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:18.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.661513 23933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:18.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.661677 23933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.25.193
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.672415 23933 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.193:0
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:18.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data/info.pb
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.193
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.25.193
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/logs
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:18.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:18.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.673805 23933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:18.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.675765 23933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:18.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.689545 23939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:18.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.689616 23938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:18.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:18.689518 23941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:18.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.690383 23933 server_base.cc:1034] running on GCE node
05:52:18.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.690972 23933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:18.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.691951 23933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.693164 23933 hybrid_clock.cc:648] HybridClock initialized: now 1783489938693099 us; error 40 us; skew 500 ppm
05:52:18.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.693415 23933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.695895 23933 webserver.cc:460] Webserver started at http://127.23.25.193:40273/ using document root <none> and password file <none>
05:52:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.696517 23933 fs_manager.cc:359] Metadata directory not provided
05:52:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.696628 23933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:18.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.696852 23933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:18.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.699362 23933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data/instance:
05:52:18.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8865c70314748c79dfdb7a79e2423c2"
05:52:18.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:18 on dist-test-slave-fnnq"
05:52:18.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.700289 23933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal/instance:
05:52:18.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8865c70314748c79dfdb7a79e2423c2"
05:52:18.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:18 on dist-test-slave-fnnq"
05:52:18.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.705440 23933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
05:52:18.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.708930 23947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:18.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.710181 23933 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
05:52:18.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.710474 23933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal
05:52:18.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e8865c70314748c79dfdb7a79e2423c2"
05:52:18.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:18 on dist-test-slave-fnnq"
05:52:18.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.710675 23933 fs_report.cc:383] FS layout report
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data/data
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:18.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:18.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.730430 23933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:18.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.731552 23933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:18.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.731909 23933 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:18.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.732983 23933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.734542 23933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.734619 23933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.734709 23933 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:18.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.734750 23933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:18.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.772284 23933 rpc_server.cc:307] RPC server started. Bound to: 127.23.25.193:37713
05:52:18.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.772320 24059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.25.193:37713 every 8 connection(s)
05:52:18.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.773658 23933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/data/info.pb
05:52:18.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.774075 23655 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 23933
05:52:18.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.774319 23655 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-0/wal/instance
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.788213 23655 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/logs
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data/info.pb
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.194:0
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.25.194
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.194
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.812129 24060 heartbeater.cc:347] Connected to a master server at 127.23.25.254:39525
05:52:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.812500 24060 heartbeater.cc:464] Registering TS with master...
05:52:18.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.813549 24060 heartbeater.cc:511] Master 127.23.25.254:39525 requested a full tablet report, sending...
05:52:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.816082 23696 ts_manager.cc:194] Registered new tserver with Master: e8865c70314748c79dfdb7a79e2423c2 (127.23.25.193:37713)
05:52:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.816098 24061 heartbeater.cc:347] Connected to a master server at 127.23.25.252:36533
05:52:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.816275 24061 heartbeater.cc:464] Registering TS with master...
05:52:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.816867 24061 heartbeater.cc:511] Master 127.23.25.252:36533 requested a full tablet report, sending...
05:52:18.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.818053 23696 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.25.193:58779
05:52:18.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.819766 23839 ts_manager.cc:194] Registered new tserver with Master: e8865c70314748c79dfdb7a79e2423c2 (127.23.25.193:37713)
05:52:18.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.820161 23892 catalog_manager.cc:1259] Loaded cluster ID: 1ec07ef012d54b58a443ab9c940baac6
05:52:18.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.820242 23892 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: loading cluster ID for follower catalog manager: success
05:52:18.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.822111 24062 heartbeater.cc:347] Connected to a master server at 127.23.25.253:38185
05:52:18.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.822271 24062 heartbeater.cc:464] Registering TS with master...
05:52:18.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.822733 24062 heartbeater.cc:511] Master 127.23.25.253:38185 requested a full tablet report, sending...
05:52:18.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.823366 23892 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: acquiring CA information for follower catalog manager: success
05:52:18.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.824882 23768 ts_manager.cc:194] Registered new tserver with Master: e8865c70314748c79dfdb7a79e2423c2 (127.23.25.193:37713)
05:52:18.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:18.825169 23892 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:52:19.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.084475 23920 catalog_manager.cc:1259] Loaded cluster ID: 1ec07ef012d54b58a443ab9c940baac6
05:52:19.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.084596 23920 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: loading cluster ID for follower catalog manager: success
05:52:19.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.088495 23920 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: acquiring CA information for follower catalog manager: success
05:52:19.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.091017 23920 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
05:52:19.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.147426 24067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:19.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.147773 24067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:19.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.147853 24067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:19.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.155412 24067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:19.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.155694 24067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.25.194
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.165042 24067 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.194:0
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data/info.pb
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.194
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.25.194
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/logs
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:19.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:19.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.166510 24067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:19.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.168359 24067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.181502 24078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:19.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.181564 24076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.182024 24075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:19.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.182312 24067 server_base.cc:1034] running on GCE node
05:52:19.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.182915 24067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:19.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.184048 24067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:19.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.185293 24067 hybrid_clock.cc:648] HybridClock initialized: now 1783489939185230 us; error 35 us; skew 500 ppm
05:52:19.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.185570 24067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:19.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.187939 24067 webserver.cc:460] Webserver started at http://127.23.25.194:42841/ using document root <none> and password file <none>
05:52:19.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.188562 24067 fs_manager.cc:359] Metadata directory not provided
05:52:19.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.188666 24067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:19.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.188905 24067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:19.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.191397 24067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data/instance:
05:52:19.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "565c54932ccb4be0913bca1803a92328"
05:52:19.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:19 on dist-test-slave-fnnq"
05:52:19.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.192150 24067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal/instance:
05:52:19.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "565c54932ccb4be0913bca1803a92328"
05:52:19.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:19 on dist-test-slave-fnnq"
05:52:19.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.196965 24067 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
05:52:19.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.200194 24084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.201539 24067 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:52:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.201668 24067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal
05:52:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "565c54932ccb4be0913bca1803a92328"
05:52:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:19 on dist-test-slave-fnnq"
05:52:19.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.201812 24067 fs_report.cc:383] FS layout report
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data/data
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:19.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:19.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.232221 24067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:19.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.232980 24067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:19.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.233228 24067 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:19.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.234112 24067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:19.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.235553 24067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:19.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.235626 24067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:19.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.235709 24067 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:19.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.235745 24067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:19.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.269676 24067 rpc_server.cc:307] RPC server started. Bound to: 127.23.25.194:40385
05:52:19.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.269723 24196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.25.194:40385 every 8 connection(s)
05:52:19.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.270903 24067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/data/info.pb
05:52:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.272181 23655 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 24067
05:52:19.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.272326 23655 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-1/wal/instance
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.277865 23655 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskAojDjo/build/asan/bin/kudu
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/logs
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data/info.pb
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:19.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.195:0
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.25.195
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.195
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:19.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
05:52:19.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.298035 24199 heartbeater.cc:347] Connected to a master server at 127.23.25.253:38185
05:52:19.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.298408 24199 heartbeater.cc:464] Registering TS with master...
05:52:19.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.299405 24199 heartbeater.cc:511] Master 127.23.25.253:38185 requested a full tablet report, sending...
05:52:19.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.300405 24197 heartbeater.cc:347] Connected to a master server at 127.23.25.254:39525
05:52:19.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.300536 24197 heartbeater.cc:464] Registering TS with master...
05:52:19.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.300961 24197 heartbeater.cc:511] Master 127.23.25.254:39525 requested a full tablet report, sending...
05:52:19.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.301118 24198 heartbeater.cc:347] Connected to a master server at 127.23.25.252:36533
05:52:19.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.301231 24198 heartbeater.cc:464] Registering TS with master...
05:52:19.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.301285 23768 ts_manager.cc:194] Registered new tserver with Master: 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:19.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.301630 24198 heartbeater.cc:511] Master 127.23.25.252:36533 requested a full tablet report, sending...
05:52:19.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.301872 23696 ts_manager.cc:194] Registered new tserver with Master: 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:19.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.302579 23839 ts_manager.cc:194] Registered new tserver with Master: 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:19.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.302944 23696 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.25.194:38377
05:52:19.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.610029 24204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
05:52:19.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.610320 24204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
05:52:19.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.610427 24204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
05:52:19.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.617693 24204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
05:52:19.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.617888 24204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.25.195
05:52:19.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.626662 24204 tablet_server_runner.cc:78] Tablet server non-default flags:
05:52:19.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.25.212:35823
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.25.195:0
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data/info.pb
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.25.195
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.25.254:39525,127.23.25.253:38185,127.23.25.252:36533
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.25.195
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/logs
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Jul 2026 03:56:09 UTC on ccycloud.quasar-kartrx.root.comops.site
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4492622
05:52:19.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
05:52:19.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.627971 24204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
05:52:19.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.629637 24204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
05:52:19.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.642719 24210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:19.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.642765 24212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:19.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:19.642791 24209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
05:52:19.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.643875 24204 server_base.cc:1034] running on GCE node
05:52:19.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.644425 24204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
05:52:19.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.645288 24204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
05:52:19.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.646553 24204 hybrid_clock.cc:648] HybridClock initialized: now 1783489939646473 us; error 43 us; skew 500 ppm
05:52:19.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.646884 24204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
05:52:19.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.649304 24204 webserver.cc:460] Webserver started at http://127.23.25.195:42057/ using document root <none> and password file <none>
05:52:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.649987 24204 fs_manager.cc:359] Metadata directory not provided
05:52:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.650146 24204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
05:52:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.650452 24204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
05:52:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.653152 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data/instance:
05:52:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06cad86a90fd4445a3df873de66d021e"
05:52:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:19 on dist-test-slave-fnnq"
05:52:19.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.653932 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal/instance:
05:52:19.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06cad86a90fd4445a3df873de66d021e"
05:52:19.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:19 on dist-test-slave-fnnq"
05:52:19.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.659161 24204 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
05:52:19.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.662725 24218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.664141 24204 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.664273 24204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data,/tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "06cad86a90fd4445a3df873de66d021e"
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 05:52:19 on dist-test-slave-fnnq"
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.664551 24204 fs_report.cc:383] FS layout report
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data/data
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
05:52:19.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
05:52:19.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
05:52:19.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.681303 24204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
05:52:19.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.682021 24204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
05:52:19.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.682260 24204 kserver.cc:163] Server-wide thread pool size limit: 3276
05:52:19.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.683125 24204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
05:52:19.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.684592 24204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
05:52:19.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.684670 24204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
05:52:19.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.684752 24204 ts_tablet_manager.cc:610] Registered 0 tablets
05:52:19.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.684788 24204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
05:52:19.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.717042 24204 rpc_server.cc:307] RPC server started. Bound to: 127.23.25.195:33071
05:52:19.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.717082 24330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.25.195:33071 every 8 connection(s)
05:52:19.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.718355 24204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/data/info.pb
05:52:19.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.719697 23655 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAojDjo/build/asan/bin/kudu as pid 24204
05:52:19.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.719866 23655 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAojDjo/test-tmp/mini-kudu-cluster1327662039187783757/ts-2/wal/instance
05:52:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.746806 24331 heartbeater.cc:347] Connected to a master server at 127.23.25.254:39525
05:52:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.746889 24332 heartbeater.cc:347] Connected to a master server at 127.23.25.252:36533
05:52:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.747138 24331 heartbeater.cc:464] Registering TS with master...
05:52:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.747145 24332 heartbeater.cc:464] Registering TS with master...
05:52:19.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.747993 24332 heartbeater.cc:511] Master 127.23.25.252:36533 requested a full tablet report, sending...
05:52:19.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.748023 24331 heartbeater.cc:511] Master 127.23.25.254:39525 requested a full tablet report, sending...
05:52:19.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.749505 23696 ts_manager.cc:194] Registered new tserver with Master: 06cad86a90fd4445a3df873de66d021e (127.23.25.195:33071)
05:52:19.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.749735 23839 ts_manager.cc:194] Registered new tserver with Master: 06cad86a90fd4445a3df873de66d021e (127.23.25.195:33071)
05:52:19.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.750608 23696 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.23.25.195:42993
05:52:19.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.758250 24333 heartbeater.cc:347] Connected to a master server at 127.23.25.253:38185
05:52:19.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.758368 24333 heartbeater.cc:464] Registering TS with master...
05:52:19.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.758718 24333 heartbeater.cc:511] Master 127.23.25.253:38185 requested a full tablet report, sending...
05:52:19.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.759749 23768 ts_manager.cc:194] Registered new tserver with Master: 06cad86a90fd4445a3df873de66d021e (127.23.25.195:33071)
05:52:19.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.768528 23655 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
05:52:19.770 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
05:52:19.770 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

05:52:19.772 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.25.254"
      port: 39525
    }
    bound_http_address {
      host: "127.23.25.254"
      port: 38681
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.25.253"
      port: 38185
    }
    bound_http_address {
      host: "127.23.25.253"
      port: 34375
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.25.252"
      port: 36533
    }
    bound_http_address {
      host: "127.23.25.252"
      port: 42333
    }
  }
}

05:52:19.772 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

05:52:19.774 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.25.193"
      port: 37713
    }
    bound_http_address {
      host: "127.23.25.193"
      port: 40273
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.25.194"
      port: 40385
    }
    bound_http_address {
      host: "127.23.25.194"
      port: 42841
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.25.195"
      port: 33071
    }
    bound_http_address {
      host: "127.23.25.195"
      port: 42057
    }
  }
}

05:52:19.774 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
05:52:19.776 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:52:19.779 [DEBUG - Time-limited test] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
05:52:19.781 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.25.253:38185(127.23.25.253:38185)] connecting to peer
05:52:19.782 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:19.784 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.25.252:36533(127.23.25.252:36533)] connecting to peer
05:52:19.784 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.25.253:38185(127.23.25.253:38185)] Successfully connected to peer
05:52:19.786 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.25.254:39525(127.23.25.254:39525)] Successfully connected to peer
05:52:19.788 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.25.253
05:52:19.789 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.25.254
05:52:19.794 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.25.252:36533(127.23.25.252:36533)] Successfully connected to peer
05:52:19.804 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.23.25.252
05:52:19.811 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xba7b4245, L:/127.0.0.1:34354 - R:/127.23.25.254:39525] using SASL/PLAIN
05:52:19.814 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:52:19.814 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=33), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [33ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: OK, deferred=null) after lookup
05:52:19.817 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.23.25.254:39525
05:52:19.817 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

05:52:19.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.818470 23655 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23666
05:52:19.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.819825 23727 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:19.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.821475 24060 heartbeater.cc:503] Master 127.23.25.254:39525 was elected leader, sending a full tablet report...
05:52:19.829 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x9b77dbe8, L:/127.0.0.1:36606 - R:/127.23.25.253:38185] using SASL/PLAIN
05:52:19.830 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x77d067fd, L:/127.0.0.1:36336 - R:/127.23.25.252:36533] using SASL/PLAIN
05:52:19.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:19.961254 23655 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23666
05:52:19.983 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.25.254:39525(127.23.25.254:39525)] handling channelInactive
05:52:19.983 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
05:52:19.983 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state READY due to: connection closed
05:52:19.984 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:19.985 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:19.985 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:19.985 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.23.25.254:39525(127.23.25.254:39525) for tablet Kudu Master: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.002 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.004 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.004 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.005 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.022 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.023 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.025 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.042 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.043 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.044 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.044 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.045 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.061 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.062 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.063 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.063 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.064 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.082 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.083 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.083 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.084 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.085 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.102 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.103 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.103 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.104 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.105 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.162 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.165 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.165 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.165 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.166 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.262 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.263 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.263 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.264 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.265 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:20.305007 24197 heartbeater.cc:503] Master 127.23.25.254:39525 was elected leader, sending a full tablet report...
05:52:20.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:20.306556 24197 heartbeater.cc:644] Failed to heartbeat to 127.23.25.254:39525 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:20.561 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:20.563 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.563 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.563 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:20.564 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533; will retry
05:52:20.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:20.753221 24331 heartbeater.cc:503] Master 127.23.25.254:39525 was elected leader, sending a full tablet report...
05:52:20.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:20.754622 24331 heartbeater.cc:644] Failed to heartbeat to 127.23.25.254:39525 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:20.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:20.824782 24060 heartbeater.cc:644] Failed to heartbeat to 127.23.25.254:39525 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:21.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.166203 24346 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c05e49a0af94b2e9ba5a1fe790c7f01)
05:52:21.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.166384 24346 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:21.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.167626 24346 leader_election.cc:288] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525), 3a28297a49194d9a85fe05056c0c9e07 (127.23.25.253:38185)
05:52:21.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.168365 23777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3a28297a49194d9a85fe05056c0c9e07" is_pre_election: true
05:52:21.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.168696 23824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:21.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.170131 23824 leader_election.cc:334] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525): Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:21.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.170331 23824 leader_election.cc:302] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6f985e8f8314e5ea166292d5dcb5ae1; no voters: 3a28297a49194d9a85fe05056c0c9e07, 8c05e49a0af94b2e9ba5a1fe790c7f01
05:52:21.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.170727 24346 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
05:52:21.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.258958 24349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c05e49a0af94b2e9ba5a1fe790c7f01)
05:52:21.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.259159 24349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:21.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.260495 24349 leader_election.cc:288] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525), a6f985e8f8314e5ea166292d5dcb5ae1 (127.23.25.252:36533)
05:52:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.261126 23848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a28297a49194d9a85fe05056c0c9e07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" is_pre_election: true
05:52:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.261374 23848 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a28297a49194d9a85fe05056c0c9e07 in term 1.
05:52:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.261969 23754 leader_election.cc:302] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a28297a49194d9a85fe05056c0c9e07, a6f985e8f8314e5ea166292d5dcb5ae1; no voters: 
05:52:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.262458 24349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Leader pre-election won for term 2
05:52:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.262701 24349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c05e49a0af94b2e9ba5a1fe790c7f01)
05:52:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.262849 24349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 1 FOLLOWER]: Advancing to term 2
05:52:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.262853 23753 leader_election.cc:334] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525): Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:21.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.264930 24349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:21.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.265508 24349 leader_election.cc:288] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [CANDIDATE]: Term 2 election: Requested vote from peers 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525), a6f985e8f8314e5ea166292d5dcb5ae1 (127.23.25.252:36533)
05:52:21.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.266036 23848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a28297a49194d9a85fe05056c0c9e07" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1"
05:52:21.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.266216 23848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 1 FOLLOWER]: Advancing to term 2
05:52:21.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.266839 23753 leader_election.cc:334] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525): Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111)
05:52:21.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.268095 23848 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a28297a49194d9a85fe05056c0c9e07 in term 2.
05:52:21.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.268527 23754 leader_election.cc:302] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a28297a49194d9a85fe05056c0c9e07, a6f985e8f8314e5ea166292d5dcb5ae1; no voters: 8c05e49a0af94b2e9ba5a1fe790c7f01
05:52:21.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.268875 24349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 2 FOLLOWER]: Leader election won for term 2
05:52:21.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.269270 24349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [term 2 LEADER]: Becoming Leader. State: Replica: 3a28297a49194d9a85fe05056c0c9e07, State: Running, Role: LEADER
05:52:21.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.269925 24349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } }
05:52:21.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.271703 24352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a28297a49194d9a85fe05056c0c9e07. Latest consensus state: current_term: 2 leader_uuid: "3a28297a49194d9a85fe05056c0c9e07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:21.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.272043 24352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: This master's current role is: LEADER
05:52:21.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.272734 24354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
05:52:21.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.274348 24354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
05:52:21.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.275130 24354 catalog_manager.cc:1259] Loaded cluster ID: 1ec07ef012d54b58a443ab9c940baac6
05:52:21.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.275229 24354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
05:52:21.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.276366 24354 catalog_manager.cc:1504] Loading token signing keys...
05:52:21.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.277212 24354 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07: Loaded TSK: 0
05:52:21.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.278096 24354 catalog_manager.cc:1514] Initializing in-progress tserver states...
05:52:21.542 [DEBUG - pool-17-thread-1] (Connection.java:748) [peer master-127.23.25.254:39525(127.23.25.254:39525)] connecting to peer
05:52:21.543 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:21.543 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.25.254:39525(127.23.25.254:39525)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:21.543 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.23.25.254:39525: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525
05:52:21.546 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
05:52:21.547 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=50000, elapsed=1562), Traces: [0ms] sending RPC to server master-127.23.25.254:39525, [1ms] received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [1ms] delaying RPC due to: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [17ms] refreshing cache from master, [17ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [18ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [19ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [20ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [21ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [21ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [37ms] refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [38ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [39ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [40ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [41ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [57ms] refreshing cache from master, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [58ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [60ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [61ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [77ms] refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [79ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [79ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [80ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [97ms] refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [99ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [100ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [101ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [118ms] refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [119ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [120ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [120ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [121ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [177ms] refreshing cache from master, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [178ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [179ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [180ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [181ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [182ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [277ms] refreshing cache from master, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [278ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [279ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [280ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [280ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [281ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [281ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [577ms] refreshing cache from master, [577ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [577ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [578ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [579ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [580ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, [580ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [580ms] delaying RPC due to: Service unavailable: Master config (127.23.25.253:38185,127.23.25.254:39525,127.23.25.252:36533) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [1557ms] refreshing cache from master, [1557ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.253:38185, [1558ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.254:39525, [1558ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.25.252:36533, [1559ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.254:39525: Network error: Failed to connect to peer master-127.23.25.254:39525(127.23.25.254:39525): Connection refused: /127.23.25.254:39525, [1560ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.252:36533: OK, [1561ms] Sub RPC ConnectToMaster: received response from server master-127.23.25.253:38185: OK, deferred=Deferred@1850548865(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduClient$$Lambda$71/1218344705@1114ba75 -> org.apache.kudu.client.AsyncKuduClient$$Lambda$72/1606002157@79c2cdf4 -> wakeup thread Time-limited test -> (continuation of Deferred@1037087768 after retry RPC after error@974045193) -> (continuation of Deferred@243073583 after retry RPC after error@1639957369) -> (continuation of Deferred@1501023010 after retry RPC after error@364205709) -> (continuation of Deferred@1933525614 after retry RPC after error@1812263803) -> (continuation of Deferred@189598466 after retry RPC after error@888354264) -> (continuation of Deferred@1037450522 after retry RPC after error@1979883248) -> (continuation of Deferred@359960105 after retry RPC after error@939799722) -> (continuation of Deferred@876015709 after retry RPC after error@1445006645) -> (continuation of Deferred@1729479710 after retry RPC after error@2116881714), errback=passthrough -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1037087768 after retry RPC after error@974045193) -> (continuation of Deferred@243073583 after retry RPC after error@1639957369) -> (continuation of Deferred@1501023010 after retry RPC after error@364205709) -> (continuation of Deferred@1933525614 after retry RPC after error@1812263803) -> (continuation of Deferred@189598466 after retry RPC after error@888354264) -> (continuation of Deferred@1037450522 after retry RPC after error@1979883248) -> (continuation of Deferred@359960105 after retry RPC after error@939799722) -> (continuation of Deferred@876015709 after retry RPC after error@1445006645) -> (continuation of Deferred@1729479710 after retry RPC after error@2116881714))) after lookup
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.549829 23768 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36606:
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestMasterFailover-killBefore=CREATE_TABLE"
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:21.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
05:52:21.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
05:52:21.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.557260 23768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestMasterFailover-killBefore=CREATE_TABLE in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
05:52:21.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.562147 23848 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [term 2 FOLLOWER]: Refusing update from remote peer 3a28297a49194d9a85fe05056c0c9e07: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
05:52:21.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.562868 23753 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 -> Peer 8c05e49a0af94b2e9ba5a1fe790c7f01 (127.23.25.254:39525): Couldn't send request to peer 8c05e49a0af94b2e9ba5a1fe790c7f01. Status: Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
05:52:21.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.562975 24352 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
05:52:21.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.565325 24346 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a28297a49194d9a85fe05056c0c9e07. Latest consensus state: current_term: 2 leader_uuid: "3a28297a49194d9a85fe05056c0c9e07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:21.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.565645 24346 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:21.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.567129 24352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3a28297a49194d9a85fe05056c0c9e07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:21.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.567440 24352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a28297a49194d9a85fe05056c0c9e07 [sys.catalog]: This master's current role is: LEADER
05:52:21.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.568378 24346 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3a28297a49194d9a85fe05056c0c9e07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c05e49a0af94b2e9ba5a1fe790c7f01" member_type: VOTER last_known_addr { host: "127.23.25.254" port: 39525 } } peers { permanent_uuid: "3a28297a49194d9a85fe05056c0c9e07" member_type: VOTER last_known_addr { host: "127.23.25.253" port: 38185 } } peers { permanent_uuid: "a6f985e8f8314e5ea166292d5dcb5ae1" member_type: VOTER last_known_addr { host: "127.23.25.252" port: 36533 } } }
05:52:21.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.568686 24346 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f985e8f8314e5ea166292d5dcb5ae1 [sys.catalog]: This master's current role is: FOLLOWER
05:52:21.573 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table ff58c76b6a374f6c91278ab9d59897e2
05:52:21.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.589412 24266 tablet_service.cc:1467] Processing CreateTablet for tablet d379e960ff8842568bc826fa60b88e1e (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=ff58c76b6a374f6c91278ab9d59897e2]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:21.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.592674 24266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d379e960ff8842568bc826fa60b88e1e. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:21.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.592459 24132 tablet_service.cc:1467] Processing CreateTablet for tablet d379e960ff8842568bc826fa60b88e1e (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=ff58c76b6a374f6c91278ab9d59897e2]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:21.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.593772 24132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d379e960ff8842568bc826fa60b88e1e. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:21.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.597378 23995 tablet_service.cc:1467] Processing CreateTablet for tablet d379e960ff8842568bc826fa60b88e1e (DEFAULT_TABLE table=TestMasterFailover-killBefore=CREATE_TABLE [id=ff58c76b6a374f6c91278ab9d59897e2]), partition=RANGE (key) PARTITION UNBOUNDED
05:52:21.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.598485 23995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d379e960ff8842568bc826fa60b88e1e. 1 dirs total, 0 dirs full, 0 dirs failed
05:52:21.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.606843 24367 tablet_bootstrap.cc:492] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: Bootstrap starting.
05:52:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.608103 24368 tablet_bootstrap.cc:492] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: Bootstrap starting.
05:52:21.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.610584 24369 tablet_bootstrap.cc:492] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: Bootstrap starting.
05:52:21.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.611323 24367 tablet_bootstrap.cc:654] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: Neither blocks nor log segments found. Creating new log.
05:52:21.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.611477 24368 tablet_bootstrap.cc:654] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: Neither blocks nor log segments found. Creating new log.
05:52:21.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.612625 24367 log.cc:824] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: Log is configured to *not* fsync() on all Append() calls
05:52:21.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.612622 24368 log.cc:824] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: Log is configured to *not* fsync() on all Append() calls
05:52:21.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.613703 24369 tablet_bootstrap.cc:654] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: Neither blocks nor log segments found. Creating new log.
05:52:21.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.615067 24369 log.cc:824] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: Log is configured to *not* fsync() on all Append() calls
05:52:21.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.615626 24367 tablet_bootstrap.cc:492] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: No bootstrap required, opened a new log
05:52:21.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.615906 24367 ts_tablet_manager.cc:1397] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: Time spent bootstrapping tablet: real 0.009s	user 0.006s	sys 0.002s
05:52:21.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.616146 24368 tablet_bootstrap.cc:492] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: No bootstrap required, opened a new log
05:52:21.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.616406 24368 ts_tablet_manager.cc:1397] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.003s
05:52:21.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.618079 24369 tablet_bootstrap.cc:492] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: No bootstrap required, opened a new log
05:52:21.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.618352 24369 ts_tablet_manager.cc:1397] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: Time spent bootstrapping tablet: real 0.008s	user 0.003s	sys 0.002s
05:52:21.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.626633 24368 raft_consensus.cc:348] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.627017 24368 raft_consensus.cc:374] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:21.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.627133 24368 raft_consensus.cc:729] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06cad86a90fd4445a3df873de66d021e, State: Initialized, Role: FOLLOWER
05:52:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.627815 24368 consensus_queue.cc:260] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.627853 24369 raft_consensus.cc:348] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.628516 24369 raft_consensus.cc:374] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.628326 24367 raft_consensus.cc:348] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.628769 24367 raft_consensus.cc:374] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
05:52:21.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.628886 24367 raft_consensus.cc:729] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565c54932ccb4be0913bca1803a92328, State: Initialized, Role: FOLLOWER
05:52:21.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.628821 24369 raft_consensus.cc:729] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8865c70314748c79dfdb7a79e2423c2, State: Initialized, Role: FOLLOWER
05:52:21.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.629669 24368 ts_tablet_manager.cc:1428] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
05:52:21.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.629563 24367 consensus_queue.cc:260] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.630064 24369 consensus_queue.cc:260] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.635183 24199 heartbeater.cc:503] Master 127.23.25.253:38185 was elected leader, sending a full tablet report...
05:52:21.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.636868 24369 ts_tablet_manager.cc:1428] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.008s
05:52:21.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.638271 24333 heartbeater.cc:503] Master 127.23.25.253:38185 was elected leader, sending a full tablet report...
05:52:21.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.640921 24367 ts_tablet_manager.cc:1428] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.008s
05:52:21.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.641270 24062 heartbeater.cc:503] Master 127.23.25.253:38185 was elected leader, sending a full tablet report...
05:52:21.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.734917 24334 tablet.cc:2369] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:21.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.777773 24200 tablet.cc:2369] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:21.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:21.819078 24068 tablet.cc:2369] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
05:52:21.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.970736 24376 raft_consensus.cc:482] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:21.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.971181 24376 raft_consensus.cc:504] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.973037 24376 leader_election.cc:288] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06cad86a90fd4445a3df873de66d021e (127.23.25.195:33071), 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.973013 24373 raft_consensus.cc:482] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
05:52:21.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.973331 24373 raft_consensus.cc:504] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.975277 24373 leader_election.cc:288] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8865c70314748c79dfdb7a79e2423c2 (127.23.25.193:37713), 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:21.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.983628 24152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "e8865c70314748c79dfdb7a79e2423c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c54932ccb4be0913bca1803a92328" is_pre_election: true
05:52:21.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.984273 24152 raft_consensus.cc:2454] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8865c70314748c79dfdb7a79e2423c2 in term 0.
05:52:21.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.984253 24015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "06cad86a90fd4445a3df873de66d021e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8865c70314748c79dfdb7a79e2423c2" is_pre_election: true
05:52:21.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.984699 24015 raft_consensus.cc:2454] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cad86a90fd4445a3df873de66d021e in term 0.
05:52:21.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985030 23949 leader_election.cc:302] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 565c54932ccb4be0913bca1803a92328, e8865c70314748c79dfdb7a79e2423c2; no voters: 
05:52:21.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985371 24220 leader_election.cc:302] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06cad86a90fd4445a3df873de66d021e, e8865c70314748c79dfdb7a79e2423c2; no voters: 
05:52:21.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985626 24376 raft_consensus.cc:2781] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:21.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985769 24376 raft_consensus.cc:482] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:21.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985807 24373 raft_consensus.cc:2781] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Leader pre-election won for term 1
05:52:21.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985880 24376 raft_consensus.cc:3037] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 0 FOLLOWER]: Advancing to term 1
05:52:21.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.985957 24373 raft_consensus.cc:482] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
05:52:21.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.986070 24373 raft_consensus.cc:3037] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 0 FOLLOWER]: Advancing to term 1
05:52:21.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.987630 24152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "06cad86a90fd4445a3df873de66d021e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c54932ccb4be0913bca1803a92328" is_pre_election: true
05:52:21.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.987838 24152 raft_consensus.cc:2454] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06cad86a90fd4445a3df873de66d021e in term 0.
05:52:21.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.987692 24286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "e8865c70314748c79dfdb7a79e2423c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cad86a90fd4445a3df873de66d021e" is_pre_election: true
05:52:21.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.989199 24373 raft_consensus.cc:504] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.989709 24286 raft_consensus.cc:2379] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8865c70314748c79dfdb7a79e2423c2 in current term 1: Already voted for candidate 06cad86a90fd4445a3df873de66d021e in this term.
05:52:21.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.989734 24376 raft_consensus.cc:504] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:21.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.989923 24373 leader_election.cc:288] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [CANDIDATE]: Term 1 election: Requested vote from peers e8865c70314748c79dfdb7a79e2423c2 (127.23.25.193:37713), 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:21.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.990628 24376 leader_election.cc:288] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [CANDIDATE]: Term 1 election: Requested vote from peers 06cad86a90fd4445a3df873de66d021e (127.23.25.195:33071), 565c54932ccb4be0913bca1803a92328 (127.23.25.194:40385)
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.990793 24152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "06cad86a90fd4445a3df873de66d021e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c54932ccb4be0913bca1803a92328"
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.990895 24285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "e8865c70314748c79dfdb7a79e2423c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06cad86a90fd4445a3df873de66d021e"
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.990995 24152 raft_consensus.cc:3037] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 0 FOLLOWER]: Advancing to term 1
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.991236 24285 raft_consensus.cc:2379] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8865c70314748c79dfdb7a79e2423c2 in current term 1: Already voted for candidate 06cad86a90fd4445a3df873de66d021e in this term.
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.990638 24015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "06cad86a90fd4445a3df873de66d021e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8865c70314748c79dfdb7a79e2423c2"
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.991536 24015 raft_consensus.cc:2379] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06cad86a90fd4445a3df873de66d021e in current term 1: Already voted for candidate e8865c70314748c79dfdb7a79e2423c2 in this term.
05:52:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.991750 24151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d379e960ff8842568bc826fa60b88e1e" candidate_uuid: "e8865c70314748c79dfdb7a79e2423c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565c54932ccb4be0913bca1803a92328"
05:52:21.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.992672 23949 leader_election.cc:302] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8865c70314748c79dfdb7a79e2423c2; no voters: 06cad86a90fd4445a3df873de66d021e, 565c54932ccb4be0913bca1803a92328
05:52:21.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.992980 24376 raft_consensus.cc:2726] T d379e960ff8842568bc826fa60b88e1e P e8865c70314748c79dfdb7a79e2423c2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
05:52:21.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.993748 24152 raft_consensus.cc:2454] T d379e960ff8842568bc826fa60b88e1e P 565c54932ccb4be0913bca1803a92328 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06cad86a90fd4445a3df873de66d021e in term 1.
05:52:21.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.994077 24220 leader_election.cc:302] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06cad86a90fd4445a3df873de66d021e, 565c54932ccb4be0913bca1803a92328; no voters: e8865c70314748c79dfdb7a79e2423c2
05:52:21.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.994329 24373 raft_consensus.cc:2781] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 1 FOLLOWER]: Leader election won for term 1
05:52:21.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.994804 24373 raft_consensus.cc:686] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [term 1 LEADER]: Becoming Leader. State: Replica: 06cad86a90fd4445a3df873de66d021e, State: Running, Role: LEADER
05:52:21.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:21.995324 24373 consensus_queue.cc:237] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } }
05:52:22.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.000001 23767 catalog_manager.cc:5495] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e reported cstate change: term changed from 0 to 1, leader changed from <none> to 06cad86a90fd4445a3df873de66d021e (127.23.25.195). New cstate: current_term: 1 leader_uuid: "06cad86a90fd4445a3df873de66d021e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06cad86a90fd4445a3df873de66d021e" member_type: VOTER last_known_addr { host: "127.23.25.195" port: 33071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 } health_report { overall_health: UNKNOWN } } }
05:52:22.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.374068 24373 consensus_queue.cc:1035] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [LEADER]: Connected to new peer: Peer: permanent_uuid: "565c54932ccb4be0913bca1803a92328" member_type: VOTER last_known_addr { host: "127.23.25.194" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:22.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.382607 24387 consensus_queue.cc:1035] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8865c70314748c79dfdb7a79e2423c2" member_type: VOTER last_known_addr { host: "127.23.25.193" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
05:52:22.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:22.415446 23753 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111) [suppressed 8 similar messages]
05:52:22.726 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table ff58c76b6a374f6c91278ab9d59897e2
05:52:22.729 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d379e960ff8842568bc826fa60b88e1e for table 'TestMasterFailover-killBefore=CREATE_TABLE' with partition [<start>, <end>)
05:52:22.729 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d379e960ff8842568bc826fa60b88e1e@[06cad86a90fd4445a3df873de66d021e(127.23.25.195:33071)[L],565c54932ccb4be0913bca1803a92328(127.23.25.194:40385),e8865c70314748c79dfdb7a79e2423c2(127.23.25.193:37713)]}]
05:52:22.730 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.25.253:38185, [3ms] Sub RPC GetTableLocations: received response from server master-127.23.25.253:38185: OK, deferred=null)) after lookup
05:52:22.730 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 06cad86a90fd4445a3df873de66d021e(127.23.25.195:33071)] connecting to peer
05:52:22.731 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 06cad86a90fd4445a3df873de66d021e(127.23.25.195:33071)] Successfully connected to peer
05:52:22.750 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6e5c1f15, L:/127.0.0.1:50676 - R:/127.23.25.195:33071] using TOKEN/null
05:52:22.758 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestMasterFailover-killBefore=CREATE_TABLE, tablet=d379e960ff8842568bc826fa60b88e1e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
05:52:22.759 [DEBUG - Time-limited test] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:52:22.765 [DEBUG - main] (Connection.java:575) [peer master-127.23.25.253:38185(127.23.25.253:38185)] disconnecting while in state READY
05:52:22.766 [DEBUG - main] (Connection.java:575) [peer master-127.23.25.254:39525(127.23.25.254:39525)] disconnecting while in state TERMINATED
05:52:22.766 [DEBUG - main] (Connection.java:575) [peer 06cad86a90fd4445a3df873de66d021e(127.23.25.195:33071)] disconnecting while in state READY
05:52:22.768 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.25.253:38185(127.23.25.253:38185)] handling channelInactive
05:52:22.768 [DEBUG - main] (Connection.java:575) [peer master-127.23.25.252:36533(127.23.25.252:36533)] disconnecting while in state READY
05:52:22.768 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.253:38185(127.23.25.253:38185)] cleaning up while in state READY due to: connection closed
05:52:22.770 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
05:52:22.771 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 06cad86a90fd4445a3df873de66d021e(127.23.25.195:33071)] handling channelInactive
05:52:22.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.771291 23655 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23933
05:52:22.772 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 06cad86a90fd4445a3df873de66d021e(127.23.25.195:33071)] cleaning up while in state READY due to: connection closed
05:52:22.772 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.25.252:36533(127.23.25.252:36533)] handling channelInactive
05:52:22.772 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.25.252:36533(127.23.25.252:36533)] cleaning up while in state READY due to: connection closed
05:52:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.794838 24055 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:22.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.825603 23805 master_runner.cc:186] Error getting master registration for 127.23.25.254:39525: Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111), 
05:52:22.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.825814 23805 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:22.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.889874 23655 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23933
05:52:22.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:22.918510 24220 connection.cc:535] client connection to 127.23.25.193:37713 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
05:52:22.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:22.918757 24220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
05:52:22.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.919148 23655 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 24067
05:52:22.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 05:52:22.921011 24220 consensus_peers.cc:487] T d379e960ff8842568bc826fa60b88e1e P 06cad86a90fd4445a3df873de66d021e -> Peer e8865c70314748c79dfdb7a79e2423c2 (127.23.25.193:37713): Couldn't send request to peer e8865c70314748c79dfdb7a79e2423c2. Status: Network error: Client connection negotiation failed: client connection to 127.23.25.193:37713: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
05:52:22.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:22.927904 24192 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:23.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.024742 23655 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 24067
05:52:23.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.041481 23655 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 24204
05:52:23.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.049476 24326 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:23.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.075667 23734 master_runner.cc:186] Error getting master registration for 127.23.25.254:39525: Network error: Client connection negotiation failed: client connection to 127.23.25.254:39525: connect: Connection refused (error 111), 
05:52:23.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.075929 23734 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
05:52:23.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.172967 23655 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 24204
05:52:23.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.192452 23655 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23734
05:52:23.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.193552 23798 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:23.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.302091 23655 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23734
05:52:23.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.321887 23655 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskAojDjo/build/asan/bin/kudu pid 23805
05:52:23.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.322923 23869 generic_service.cc:196] Checking for leaks (request via RPC)
05:52:23.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 05:52:23.427376 23655 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAojDjo/build/asan/bin/kudu with pid 23805
05:52:23.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T05:52:23Z chronyd exiting

Time: 35.372

OK (4 tests)

