JUnit version 4.13.2
.20:02:54.631 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783540974624
20:02:54.682 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:02:54.745 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:02:54.755 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskCEZtFK/test-tmp
20:02:54.761 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin
20:02:54.765 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskCEZtFK/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb]
20:02:54.967 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:02:54.983 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:02:54.984 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:02:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:54.986207 28629 mini_oidc.cc:150] Starting JWKS server
20:02:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:54.988101 28629 webserver.cc:533] Webserver started at http://127.0.0.1:38709/ using document root <none> and password file <none>
20:02:54.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:54.988291 28629 mini_oidc.cc:186] Starting OIDC Discovery server
20:02:54.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:54.988565 28629 webserver.cc:533] Webserver started at http://127.0.0.1:36313/ using document root <none> and password file <none>
20:02:54.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T20:02:54Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:02:54.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T20:02:54Z Disabled control of system clock
20:02:55.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.002965 28629 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal
20:02:55.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data
20:02:55.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:02:55.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:02:55.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:02:55.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/logs
20:02:55.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data/info.pb
20:02:55.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:02:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:02:55.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:02:55.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:02:55.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:02:55.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:02:55.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:02:55.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:02:55.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.126:35787
20:02:55.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.126
20:02:55.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:02:55.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:02:55.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38709/jwks.json with env {}
20:02:55.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.101431 28640 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:02:55.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.101647 28640 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:02:55.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.101706 28640 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:02:55.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.105221 28640 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:02:55.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.105309 28640 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:02:55.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.105338 28640 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:02:55.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.105365 28640 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:02:55.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.105389 28640 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:02:55.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.105409 28640 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38709/jwks.json
20:02:55.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.109606 28640 master_runner.cc:387] Master server non-default flags:
20:02:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data
20:02:55.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal
20:02:55.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:02:55.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:02:55.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.126:35787
20:02:55.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:02:55.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:02:55.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:02:55.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38709/jwks.json
20:02:55.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data/info.pb
20:02:55.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.126
20:02:55.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:02:55.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.28640
20:02:55.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:02:55.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:02:55.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/logs
20:02:55.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:02:55.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:02:55.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:02:55.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:02:55.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:02:55.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:02:55.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:02:55.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:02:55.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.110821 28640 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:02:55.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.112080 28640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:02:55.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.118476 28640 server_base.cc:1061] running on GCE node
20:02:55.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.118440 28646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.118594 28645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.118713 28648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.119261 28640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:02:55.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.120297 28640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:02:55.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.121435 28640 hybrid_clock.cc:648] HybridClock initialized: now 1783540975121415 us; error 40 us; skew 500 ppm
20:02:55.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.123170 28640 webserver.cc:533] Webserver started at http://127.27.245.126:33131/ using document root <none> and password file <none>
20:02:55.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.123795 28640 fs_manager.cc:362] Metadata directory not provided
20:02:55.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.123888 28640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:02:55.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.124102 28640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:02:55.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.125730 28640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data/instance:
20:02:55.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6dceaf50c5a44551be0ad18fe8bc38bf"
20:02:55.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.126242 28640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal/instance:
20:02:55.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6dceaf50c5a44551be0ad18fe8bc38bf"
20:02:55.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.130191 28640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
20:02:55.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.132177 28654 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:02:55.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.133229 28640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:02:55.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.133322 28640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal
20:02:55.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6dceaf50c5a44551be0ad18fe8bc38bf"
20:02:55.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.133384 28640 fs_report.cc:389] FS layout report
20:02:55.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:02:55.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal
20:02:55.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal
20:02:55.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data/data
20:02:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:02:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:02:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:02:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:02:55.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:02:55.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:02:55.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:02:55.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:02:55.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:02:55.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:02:55.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:02:55.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.143739 28640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:02:55.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.144219 28640 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:02:55.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.144346 28640 kserver.cc:163] Server-wide thread pool size limit: 3276
20:02:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.151046 28640 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.126:35787
20:02:55.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.151052 28707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.126:35787 every 8 connection(s)
20:02:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.151942 28640 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/data/info.pb
20:02:55.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.154565 28708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:02:55.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.157176 28708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.158735 28629 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 28640
20:02:55.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.158876 28629 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-0/wal/instance
20:02:55.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.160379 28629 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal
20:02:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data
20:02:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:02:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:02:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:02:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/logs
20:02:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data/info.pb
20:02:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:02:55.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:02:55.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:02:55.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:02:55.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.125:44697
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.125
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:02:55.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:02:55.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38709/jwks.json with env {}
20:02:55.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.169412 28708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.170089 28655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.125:44697: connect: Connection refused (error 111)
20:02:55.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.170864 28708 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.125:44697: Network error: Client connection negotiation failed: client connection to 127.27.245.125:44697: connect: Connection refused (error 111)
20:02:55.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.220130 28708 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } attempt: 1
20:02:55.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.221755 28708 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.125:44697: Network error: Client connection negotiation failed: client connection to 127.27.245.125:44697: connect: Connection refused (error 111)
20:02:55.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.264945 28712 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:02:55.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.265118 28712 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:02:55.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.265156 28712 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:02:55.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.268468 28712 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:02:55.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.268522 28712 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:02:55.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.268540 28712 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:02:55.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.268558 28712 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:02:55.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.268573 28712 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:02:55.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.268587 28712 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38709/jwks.json
20:02:55.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.273339 28712 master_runner.cc:387] Master server non-default flags:
20:02:55.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.125:44697
20:02:55.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38709/jwks.json
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data/info.pb
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.125
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.28712
20:02:55.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:02:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:02:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/logs
20:02:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:02:55.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:02:55.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:02:55.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:02:55.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:02:55.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:02:55.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:02:55.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:02:55.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.274425 28712 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:02:55.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.275528 28712 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:02:55.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.281510 28719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.281525 28718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.281879 28721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.283371 28712 server_base.cc:1061] running on GCE node
20:02:55.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.283864 28712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:02:55.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.284890 28712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:02:55.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.286051 28712 hybrid_clock.cc:648] HybridClock initialized: now 1783540975286034 us; error 38 us; skew 500 ppm
20:02:55.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.287781 28712 webserver.cc:533] Webserver started at http://127.27.245.125:45791/ using document root <none> and password file <none>
20:02:55.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.288388 28712 fs_manager.cc:362] Metadata directory not provided
20:02:55.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.288465 28712 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:02:55.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.288697 28712 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:02:55.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.289952 28708 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } attempt: 2
20:02:55.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.290462 28712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data/instance:
20:02:55.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6d2f86f39e249ae876036ce302eec5e"
20:02:55.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.290992 28712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal/instance:
20:02:55.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6d2f86f39e249ae876036ce302eec5e"
20:02:55.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.291503 28708 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.125:44697: Network error: Client connection negotiation failed: client connection to 127.27.245.125:44697: connect: Connection refused (error 111)
20:02:55.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.294672 28712 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
20:02:55.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.296799 28727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:02:55.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.297886 28712 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
20:02:55.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.298000 28712 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal
20:02:55.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6d2f86f39e249ae876036ce302eec5e"
20:02:55.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.298081 28712 fs_report.cc:389] FS layout report
20:02:55.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:02:55.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal
20:02:55.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal
20:02:55.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data/data
20:02:55.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:02:55.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:02:55.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:02:55.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:02:55.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:02:55.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.320569 28712 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:02:55.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.321300 28712 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:02:55.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.321480 28712 kserver.cc:163] Server-wide thread pool size limit: 3276
20:02:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.328148 28779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.125:44697 every 8 connection(s)
20:02:55.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.328156 28712 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.125:44697
20:02:55.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.329221 28712 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/data/info.pb
20:02:55.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.332098 28780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:02:55.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.335956 28780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.337770 28629 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 28712
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.337873 28629 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-1/wal/instance
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.338546 28629 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:02:55.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/logs
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data/info.pb
20:02:55.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.124:40597
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.124
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:02:55.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:02:55.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38709/jwks.json with env {}
20:02:55.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.346238 28780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.352859 28780 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.353612 28728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:55.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.357529 28780 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.124:40597: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:55.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.382676 28708 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } attempt: 3
20:02:55.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.387022 28708 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.388181 28708 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.124:40597: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:55.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.406805 28780 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } attempt: 1
20:02:55.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.408031 28780 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.124:40597: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:55.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.419404 28708 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } attempt: 1
20:02:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.420714 28708 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.124:40597: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:55.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.443617 28783 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:02:55.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.443822 28783 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:02:55.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.443864 28783 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:02:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.446944 28783 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:02:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.446990 28783 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:02:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.447008 28783 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:02:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.447024 28783 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:02:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.447041 28783 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:02:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.447055 28783 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38709/jwks.json
20:02:55.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.450733 28783 master_runner.cc:387] Master server non-default flags:
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.124:40597
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38709/jwks.json
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data/info.pb
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.124
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.28783
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/logs
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.451661 28783 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:02:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.452615 28783 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:02:55.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.458366 28793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.458348 28791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.458387 28790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.458523 28783 server_base.cc:1061] running on GCE node
20:02:55.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.459211 28783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:02:55.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.460215 28783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:02:55.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.461635 28783 hybrid_clock.cc:648] HybridClock initialized: now 1783540975461585 us; error 69 us; skew 500 ppm
20:02:55.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.463271 28783 webserver.cc:533] Webserver started at http://127.27.245.124:35115/ using document root <none> and password file <none>
20:02:55.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.463912 28783 fs_manager.cc:362] Metadata directory not provided
20:02:55.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.463991 28783 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:02:55.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.464222 28783 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:02:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.465845 28783 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data/instance:
20:02:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a"
20:02:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.466254 28783 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal/instance:
20:02:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a"
20:02:55.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.469163 28783 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
20:02:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.471011 28799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.471863 28783 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.471979 28783 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a"
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.472064 28783 fs_report.cc:389] FS layout report
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal
20:02:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data/data
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:02:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:02:55.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:02:55.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.476294 28780 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } attempt: 2
20:02:55.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.478056 28780 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.124:40597: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:55.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.487282 28783 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:02:55.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.487880 28783 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:02:55.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.488065 28783 kserver.cc:163] Server-wide thread pool size limit: 3276
20:02:55.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.494701 28852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.124:40597 every 8 connection(s)
20:02:55.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.494701 28783 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.124:40597
20:02:55.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.495792 28783 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/data/info.pb
20:02:55.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.495935 28708 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } attempt: 2
20:02:55.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.499318 28853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:02:55.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.502624 28853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.503911 28629 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 28783
20:02:55.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.504024 28629 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/master-2/wal/instance
20:02:55.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.507596 28708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: Bootstrap starting.
20:02:55.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.509835 28853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.510141 28708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: Neither blocks nor log segments found. Creating new log.
20:02:55.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.510926 28708 log.cc:826] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: Log is configured to *not* fsync() on all Append() calls
20:02:55.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.512907 28708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: No bootstrap required, opened a new log
20:02:55.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.514654 28853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } has no permanent_uuid. Determining permanent_uuid...
20:02:55.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.516623 28708 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.517062 28708 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:02:55.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.517131 28708 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dceaf50c5a44551be0ad18fe8bc38bf, State: Initialized, Role: FOLLOWER
20:02:55.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.517551 28708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.518618 28708 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: configured and running, proceeding with master startup.
20:02:55.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.521518 28853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a: Bootstrap starting.
20:02:55.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.522419 28862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.522748 28862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.524511 28853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a: Neither blocks nor log segments found. Creating new log.
20:02:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.525456 28853 log.cc:826] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a: Log is configured to *not* fsync() on all Append() calls
20:02:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.525620 28873 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:02:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.525676 28873 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:02:55.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.524005 28640 master_runner.cc:187] Error getting master registration for 127.27.245.125:44697: OK, instance_id { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" instance_seqno: 1783540975326422 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:02:55.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.526109 28640 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:02:55.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.527527 28853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a: No bootstrap required, opened a new log
20:02:55.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.531354 28853 raft_consensus.cc:359] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.531527 28853 raft_consensus.cc:385] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:02:55.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.531582 28853 raft_consensus.cc:740] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99f30cf0dcf6455e82ecfb9bfb2aa86a, State: Initialized, Role: FOLLOWER
20:02:55.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.532064 28853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.532919 28876 raft_consensus.cc:493] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:02:55.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.533258 28876 raft_consensus.cc:515] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.533648 28877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.533771 28853 sys_catalog.cc:565] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: configured and running, proceeding with master startup.
20:02:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.534143 28876 leader_election.cc:290] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dceaf50c5a44551be0ad18fe8bc38bf (127.27.245.126:35787), d6d2f86f39e249ae876036ce302eec5e (127.27.245.125:44697)
20:02:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.533982 28877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.534611 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" is_pre_election: true
20:02:55.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.534809 28681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99f30cf0dcf6455e82ecfb9bfb2aa86a in term 0.
20:02:55.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.535307 28800 leader_election.cc:304] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf, 99f30cf0dcf6455e82ecfb9bfb2aa86a; no voters: 
20:02:55.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.535522 28877 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Leader pre-election won for term 1
20:02:55.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.535601 28877 raft_consensus.cc:493] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:02:55.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.535673 28877 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 0 FOLLOWER]: Advancing to term 1
20:02:55.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.536942 28877 raft_consensus.cc:515] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.538075 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf"
20:02:55.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.538174 28681 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 0 FOLLOWER]: Advancing to term 1
20:02:55.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.539641 28681 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99f30cf0dcf6455e82ecfb9bfb2aa86a in term 1.
20:02:55.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.539981 28800 leader_election.cc:304] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf, 99f30cf0dcf6455e82ecfb9bfb2aa86a; no voters: 
20:02:55.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.540611 28877 leader_election.cc:290] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [CANDIDATE]: Term 1 election: Requested vote from peers 6dceaf50c5a44551be0ad18fe8bc38bf (127.27.245.126:35787), d6d2f86f39e249ae876036ce302eec5e (127.27.245.125:44697)
20:02:55.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.540982 28877 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 1 FOLLOWER]: Leader election won for term 1
20:02:55.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.541994 28877 raft_consensus.cc:697] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [term 1 LEADER]: Becoming Leader. State: Replica: 99f30cf0dcf6455e82ecfb9bfb2aa86a, State: Running, Role: LEADER
20:02:55.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.542599 28877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.543077 28783 master_runner.cc:187] Error getting master registration for 127.27.245.125:44697: OK, instance_id { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" instance_seqno: 1783540975326422 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:02:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.545171 28876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99f30cf0dcf6455e82ecfb9bfb2aa86a. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.545259 28876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: This master's current role is: LEADER
20:02:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.545282 28783 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:02:55.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.549266 28888 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:02:55.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.549336 28888 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:02:55.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.553005 28891 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
20:02:55.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.557080 28891 catalog_manager.cc:1520] Initializing Kudu cluster ID...
20:02:55.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.569453 28780 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } attempt: 3
20:02:55.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.571733 28681 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Refusing update from remote peer 99f30cf0dcf6455e82ecfb9bfb2aa86a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:02:55.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.572772 28877 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:02:55.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.576165 28780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: Bootstrap starting.
20:02:55.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.576208 28862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99f30cf0dcf6455e82ecfb9bfb2aa86a. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.576287 28862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.579702 28780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: Neither blocks nor log segments found. Creating new log.
20:02:55.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.580487 28780 log.cc:826] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: Log is configured to *not* fsync() on all Append() calls
20:02:55.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.582450 28780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: No bootstrap required, opened a new log
20:02:55.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.585937 28780 raft_consensus.cc:359] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.586349 28780 raft_consensus.cc:385] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:02:55.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.586598 28780 raft_consensus.cc:740] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6d2f86f39e249ae876036ce302eec5e, State: Initialized, Role: FOLLOWER
20:02:55.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.587291 28780 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:55.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.589039 28780 sys_catalog.cc:565] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: configured and running, proceeding with master startup.
20:02:55.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.590740 28877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.590879 28877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: This master's current role is: LEADER
20:02:55.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.591951 28752 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 0 FOLLOWER]: Advancing to term 1
20:02:55.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.591667 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d2f86f39e249ae876036ce302eec5e"
20:02:55.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.592978 28752 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Refusing update from remote peer 99f30cf0dcf6455e82ecfb9bfb2aa86a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:02:55.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.593228 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6d2f86f39e249ae876036ce302eec5e" is_pre_election: true
20:02:55.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.593369 28754 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99f30cf0dcf6455e82ecfb9bfb2aa86a in term 1.
20:02:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.595279 28876 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:02:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.596282 28892 mvcc.cc:204] Tried to move back new op lower bound from 7305383835918954496 to 7305383835828547584. Current Snapshot: MvccSnapshot[applied={T|T < 7305383835918954496}]
20:02:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.596666 28862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.596796 28862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.597095 28893 mvcc.cc:204] Tried to move back new op lower bound from 7305383835918954496 to 7305383835828547584. Current Snapshot: MvccSnapshot[applied={T|T < 7305383835918954496}]
20:02:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.597297 28896 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.597378 28896 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.598156 28891 catalog_manager.cc:1383] Generated new cluster ID: 6da5fa87406f477a84faffe157eb6c77
20:02:55.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.598212 28891 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
20:02:55.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.605177 28896 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99f30cf0dcf6455e82ecfb9bfb2aa86a. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.605314 28896 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.605399 28896 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.605454 28896 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: This master's current role is: FOLLOWER
20:02:55.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.607074 28910 mvcc.cc:204] Tried to move back new op lower bound from 7305383835918954496 to 7305383835828547584. Current Snapshot: MvccSnapshot[applied={T|T < 7305383835918954496}]
20:02:55.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.612632 28877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:02:55.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.612797 28877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a [sys.catalog]: This master's current role is: LEADER
20:02:55.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.615147 28891 catalog_manager.cc:1406] Generated new certificate authority record
20:02:55.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.616394 28891 catalog_manager.cc:1540] Loading token signing keys...
20:02:55.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.627877 28908 catalog_manager.cc:1295] Loaded cluster ID: 6da5fa87406f477a84faffe157eb6c77
20:02:55.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.628252 28908 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: loading cluster ID for follower catalog manager: success
20:02:55.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.630685 28908 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: acquiring CA information for follower catalog manager: success
20:02:55.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.631495 28908 catalog_manager.cc:883] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
20:02:55.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.634490 28891 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 99f30cf0dcf6455e82ecfb9bfb2aa86a: Generated new TSK 0
20:02:55.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.635109 28891 catalog_manager.cc:1550] Initializing in-progress tserver states...
20:02:55.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.641084 28629 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal
20:02:55.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/logs
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data/info.pb
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:02:55.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.65:0
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.245.65
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.65
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:02:55.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.787245 28917 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:02:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.788211 28917 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:02:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.788592 28917 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:02:55.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.793924 28917 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:02:55.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.794631 28917 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.245.65
20:02:55.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.800669 28917 tablet_server_runner.cc:78] Tablet server non-default flags:
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.65:0
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data/info.pb
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.65
20:02:55.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.28917
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.245.65
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/logs
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:02:55.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:02:55.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:02:55.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:02:55.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.804356 28917 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:02:55.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.805994 28917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:02:55.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.812825 28923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.812825 28925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.813249 28922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:55.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.814262 28917 server_base.cc:1061] running on GCE node
20:02:55.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.814622 28917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:02:55.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.815207 28917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:02:55.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.816351 28917 hybrid_clock.cc:648] HybridClock initialized: now 1783540975816293 us; error 73 us; skew 500 ppm
20:02:55.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.818262 28917 webserver.cc:533] Webserver started at http://127.27.245.65:44957/ using document root <none> and password file <none>
20:02:55.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.818890 28917 fs_manager.cc:362] Metadata directory not provided
20:02:55.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.818974 28917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:02:55.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.819199 28917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:02:55.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.820887 28917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data/instance:
20:02:55.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ea85607c3d9f4e589d1aaa5eb5435b75"
20:02:55.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.821915 28917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal/instance:
20:02:55.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ea85607c3d9f4e589d1aaa5eb5435b75"
20:02:55.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.830020 28917 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.003s
20:02:55.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.832844 28931 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:02:55.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.834491 28917 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.834590 28917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ea85607c3d9f4e589d1aaa5eb5435b75"
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:55 on dist-test-slave-5qxh"
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.834676 28917 fs_report.cc:389] FS layout report
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data/data
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:02:55.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:02:55.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:02:55.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:02:55.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:02:55.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:02:55.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:02:55.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:02:55.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.873535 28917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:02:55.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.874320 28917 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:02:55.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.874527 28917 kserver.cc:163] Server-wide thread pool size limit: 3276
20:02:55.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.875198 28917 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:02:55.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.876228 28917 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:02:55.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.876307 28917 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:02:55.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.876363 28917 ts_tablet_manager.cc:616] Registered 0 tablets
20:02:55.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.876389 28917 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:02:55.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.885404 28917 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.65:34549
20:02:55.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.885437 29044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.65:34549 every 8 connection(s)
20:02:55.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.886407 28917 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/data/info.pb
20:02:55.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.890767 28629 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 28917
20:02:55.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.890890 28629 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal/instance
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.894835 28629 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:55.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/logs
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data/info.pb
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.66:0
20:02:55.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.245.66
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.66
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.896471 29047 heartbeater.cc:344] Connected to a master server at 127.27.245.125:44697
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.896529 29046 heartbeater.cc:344] Connected to a master server at 127.27.245.126:35787
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.896700 29046 heartbeater.cc:461] Registering TS with master...
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.896705 29047 heartbeater.cc:461] Registering TS with master...
20:02:55.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.896798 29045 heartbeater.cc:344] Connected to a master server at 127.27.245.124:40597
20:02:55.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.896857 29045 heartbeater.cc:461] Registering TS with master...
20:02:55.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.897336 29047 heartbeater.cc:507] Master 127.27.245.125:44697 requested a full tablet report, sending...
20:02:55.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.897329 29045 heartbeater.cc:507] Master 127.27.245.124:40597 requested a full tablet report, sending...
20:02:55.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.897329 29046 heartbeater.cc:507] Master 127.27.245.126:35787 requested a full tablet report, sending...
20:02:55.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.898828 28817 ts_manager.cc:194] Registered new tserver with Master: ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549)
20:02:55.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.898960 28671 ts_manager.cc:194] Registered new tserver with Master: ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549)
20:02:55.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.899992 28744 ts_manager.cc:194] Registered new tserver with Master: ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549)
20:02:55.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:55.900146 28817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.245.65:49859
20:02:55.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.997962 29052 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:02:55.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.998145 29052 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:02:55.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:55.998183 29052 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:02:56.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.001741 29052 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:02:56.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.001839 29052 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.245.66
20:02:56.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.005666 29052 tablet_server_runner.cc:78] Tablet server non-default flags:
20:02:56.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:56.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:56.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.66:0
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data/info.pb
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.66
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29052
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.245.66
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/logs
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:02:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:02:56.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:02:56.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:02:56.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:02:56.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.006893 29052 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:02:56.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.008217 29052 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:02:56.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.014372 29060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:56.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.014484 29052 server_base.cc:1061] running on GCE node
20:02:56.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.014385 29058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:56.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.014372 29057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:56.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.014933 29052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:02:56.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.015443 29052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:02:56.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.016618 29052 hybrid_clock.cc:648] HybridClock initialized: now 1783540976016603 us; error 31 us; skew 500 ppm
20:02:56.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.018486 29052 webserver.cc:533] Webserver started at http://127.27.245.66:41815/ using document root <none> and password file <none>
20:02:56.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.018980 29052 fs_manager.cc:362] Metadata directory not provided
20:02:56.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.019032 29052 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:02:56.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.019245 29052 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:02:56.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.020815 29052 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data/instance:
20:02:56.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3038daa93d3a47cca362183b55b674ad"
20:02:56.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:56 on dist-test-slave-5qxh"
20:02:56.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.021296 29052 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal/instance:
20:02:56.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3038daa93d3a47cca362183b55b674ad"
20:02:56.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:56 on dist-test-slave-5qxh"
20:02:56.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.024715 29052 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
20:02:56.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.026662 29067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:02:56.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.027591 29052 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:02:56.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.027675 29052 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal
20:02:56.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3038daa93d3a47cca362183b55b674ad"
20:02:56.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:56 on dist-test-slave-5qxh"
20:02:56.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.027735 29052 fs_report.cc:389] FS layout report
20:02:56.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data/data
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:02:56.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:02:56.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:02:56.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:02:56.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:02:56.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:02:56.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:02:56.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.043314 29052 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:02:56.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.043838 29052 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:02:56.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.043969 29052 kserver.cc:163] Server-wide thread pool size limit: 3276
20:02:56.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.044409 29052 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:02:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.045405 29052 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:02:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.045450 29052 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:02:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.045487 29052 ts_tablet_manager.cc:616] Registered 0 tablets
20:02:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.045501 29052 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:02:56.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.054255 29052 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.66:33829
20:02:56.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.054275 29181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.66:33829 every 8 connection(s)
20:02:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.055119 29052 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/data/info.pb
20:02:56.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.062208 28629 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29052
20:02:56.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.062304 28629 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal/instance
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.064291 29183 heartbeater.cc:344] Connected to a master server at 127.27.245.126:35787
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.064359 29182 heartbeater.cc:344] Connected to a master server at 127.27.245.124:40597
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.064499 29183 heartbeater.cc:461] Registering TS with master...
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.064500 29182 heartbeater.cc:461] Registering TS with master...
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.064827 29184 heartbeater.cc:344] Connected to a master server at 127.27.245.125:44697
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.064886 29184 heartbeater.cc:461] Registering TS with master...
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.065084 28629 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:02:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/logs
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data/info.pb
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.67:0
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.245.67
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.67
20:02:56.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.065109 29182 heartbeater.cc:507] Master 127.27.245.124:40597 requested a full tablet report, sending...
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.065109 29183 heartbeater.cc:507] Master 127.27.245.126:35787 requested a full tablet report, sending...
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.065109 29184 heartbeater.cc:507] Master 127.27.245.125:44697 requested a full tablet report, sending...
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.066318 28671 ts_manager.cc:194] Registered new tserver with Master: 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829)
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.066488 28817 ts_manager.cc:194] Registered new tserver with Master: 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829)
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.067196 28817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.245.66:49983
20:02:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.067808 28744 ts_manager.cc:194] Registered new tserver with Master: 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829)
20:02:56.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.171228 29189 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:02:56.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.171468 29189 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:02:56.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.171525 29189 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:02:56.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.174944 29189 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:02:56.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.175084 29189 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.245.67
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.178931 29189 tablet_server_runner.cc:78] Tablet server non-default flags:
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.27.245.84:44791
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:02:56.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.27.245.67:0
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data/info.pb
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.27.245.67
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.27.245.126:35787,127.27.245.125:44697,127.27.245.124:40597
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29189
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.27.245.67
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/logs
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:02:56.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:02:56.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:02:56.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:02:56.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:02:56.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:02:56.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.180267 29189 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:02:56.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.181627 29189 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:02:56.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.187824 29195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:56.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.187776 29194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:56.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.187871 29189 server_base.cc:1061] running on GCE node
20:02:56.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:56.187776 29197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:02:56.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.188568 29189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:02:56.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.189069 29189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:02:56.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.190228 29189 hybrid_clock.cc:648] HybridClock initialized: now 1783540976190209 us; error 31 us; skew 500 ppm
20:02:56.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.191905 29189 webserver.cc:533] Webserver started at http://127.27.245.67:35465/ using document root <none> and password file <none>
20:02:56.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.192462 29189 fs_manager.cc:362] Metadata directory not provided
20:02:56.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.192541 29189 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:02:56.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.192801 29189 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:02:56.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.194248 29189 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data/instance:
20:02:56.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "36a78fa230584abfab390a7d0990df73"
20:02:56.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:56 on dist-test-slave-5qxh"
20:02:56.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.194769 29189 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal/instance:
20:02:56.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "36a78fa230584abfab390a7d0990df73"
20:02:56.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:56 on dist-test-slave-5qxh"
20:02:56.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.197995 29189 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
20:02:56.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.200026 29203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:02:56.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.201085 29189 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
20:02:56.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.201201 29189 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal
20:02:56.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "36a78fa230584abfab390a7d0990df73"
20:02:56.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:02:56 on dist-test-slave-5qxh"
20:02:56.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.201287 29189 fs_report.cc:389] FS layout report
20:02:56.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data/data
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:02:56.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:02:56.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.219919 29189 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:02:56.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.220616 29189 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:02:56.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.220873 29189 kserver.cc:163] Server-wide thread pool size limit: 3276
20:02:56.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.221599 29189 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:02:56.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.222676 29189 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:02:56.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.222749 29189 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:02:56.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.222808 29189 ts_tablet_manager.cc:616] Registered 0 tablets
20:02:56.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.222832 29189 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:02:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.232447 29189 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.67:37081
20:02:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.232471 29317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.67:37081 every 8 connection(s)
20:02:56.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.233500 29189 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/data/info.pb
20:02:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.241629 28629 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29189
20:02:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.241729 28629 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-2/wal/instance
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.242260 29318 heartbeater.cc:344] Connected to a master server at 127.27.245.124:40597
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.242314 29320 heartbeater.cc:344] Connected to a master server at 127.27.245.125:44697
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.242383 29319 heartbeater.cc:344] Connected to a master server at 127.27.245.126:35787
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.242463 29320 heartbeater.cc:461] Registering TS with master...
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.242465 29318 heartbeater.cc:461] Registering TS with master...
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.242463 29319 heartbeater.cc:461] Registering TS with master...
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.243049 29320 heartbeater.cc:507] Master 127.27.245.125:44697 requested a full tablet report, sending...
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.243050 29319 heartbeater.cc:507] Master 127.27.245.126:35787 requested a full tablet report, sending...
20:02:56.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.243049 29318 heartbeater.cc:507] Master 127.27.245.124:40597 requested a full tablet report, sending...
20:02:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.244120 28817 ts_manager.cc:194] Registered new tserver with Master: 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.244163 28671 ts_manager.cc:194] Registered new tserver with Master: 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.244240 28744 ts_manager.cc:194] Registered new tserver with Master: 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:56.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.244781 28817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.245.67:53247
20:02:56.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.248461 28629 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
20:02:56.249 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:02:56.250 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:02:56.259 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.27.245.126"
      port: 35787
    }
    bound_http_address {
      host: "127.27.245.126"
      port: 33131
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.27.245.125"
      port: 44697
    }
    bound_http_address {
      host: "127.27.245.125"
      port: 45791
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.27.245.124"
      port: 40597
    }
    bound_http_address {
      host: "127.27.245.124"
      port: 35115
    }
  }
}

20:02:56.262 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:02:56.264 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.27.245.65"
      port: 34549
    }
    bound_http_address {
      host: "127.27.245.65"
      port: 44957
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.27.245.66"
      port: 33829
    }
    bound_http_address {
      host: "127.27.245.66"
      port: 41815
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.27.245.67"
      port: 37081
    }
    bound_http_address {
      host: "127.27.245.67"
      port: 35465
    }
  }
}

20:02:56.264 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:02:56.450 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
20:02:56.514 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:02:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.527096 28873 catalog_manager.cc:1295] Loaded cluster ID: 6da5fa87406f477a84faffe157eb6c77
20:02:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.527173 28873 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: loading cluster ID for follower catalog manager: success
20:02:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.529472 28873 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: acquiring CA information for follower catalog manager: success
20:02:56.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.530683 28873 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:02:56.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.633543 28908 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:02:56.670 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.27.245.125:44697(127.27.245.125:44697)] connecting to peer
20:02:56.717 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.27.245.126:35787(127.27.245.126:35787)] connecting to peer
20:02:56.718 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:56.734 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.27.245.124:40597(127.27.245.124:40597)] Successfully connected to peer
20:02:56.734 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.27.245.126:35787(127.27.245.126:35787)] Successfully connected to peer
20:02:56.734 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.27.245.125:44697(127.27.245.125:44697)] Successfully connected to peer
20:02:56.821 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.27.245.126
20:02:56.821 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.27.245.124
20:02:56.823 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.27.245.125
20:02:56.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:56.901891 29045 heartbeater.cc:499] Master 127.27.245.124:40597 was elected leader, sending a full tablet report...
20:02:57.028 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xe85fee6f, L:/127.0.0.1:45676 - R:/127.27.245.126:35787] using SASL/PLAIN
20:02:57.028 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x670db65a, L:/127.0.0.1:54206 - R:/127.27.245.125:44697] using SASL/PLAIN
20:02:57.029 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xa752ee14, L:/127.0.0.1:34080 - R:/127.27.245.124:40597] using SASL/PLAIN
20:02:57.062 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:02:57.062 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=436), Traces: [0ms] refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [409ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [409ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [411ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: OK, deferred=null) after lookup
20:02:57.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.068845 29182 heartbeater.cc:499] Master 127.27.245.124:40597 was elected leader, sending a full tablet report...
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.106932 28817 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34080:
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:02:57.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:02:57.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:02:57.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:02:57.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:02:57.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:02:57.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:02:57.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:57.108397 28817 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:02:57.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.133527 29115 tablet_service.cc:1511] Processing CreateTablet for tablet 4988e9d699ae4cc2b3ce9579444c3d98 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2]), partition=RANGE (key) PARTITION UNBOUNDED
20:02:57.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.134574 29115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4988e9d699ae4cc2b3ce9579444c3d98. 1 dirs total, 0 dirs full, 0 dirs failed
20:02:57.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.137989 29251 tablet_service.cc:1511] Processing CreateTablet for tablet 4988e9d699ae4cc2b3ce9579444c3d98 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2]), partition=RANGE (key) PARTITION UNBOUNDED
20:02:57.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.138926 29251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4988e9d699ae4cc2b3ce9579444c3d98. 1 dirs total, 0 dirs full, 0 dirs failed
20:02:57.140 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58c6f69e7d0346739264583cc6871cd2
20:02:57.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.144591 29349 tablet_bootstrap.cc:492] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: Bootstrap starting.
20:02:57.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.147007 29349 tablet_bootstrap.cc:654] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: Neither blocks nor log segments found. Creating new log.
20:02:57.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.147734 29349 log.cc:826] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: Log is configured to *not* fsync() on all Append() calls
20:02:57.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.150722 28979 tablet_service.cc:1511] Processing CreateTablet for tablet 4988e9d699ae4cc2b3ce9579444c3d98 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2]), partition=RANGE (key) PARTITION UNBOUNDED
20:02:57.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.151707 28979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4988e9d699ae4cc2b3ce9579444c3d98. 1 dirs total, 0 dirs full, 0 dirs failed
20:02:57.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.162964 29348 tablet_bootstrap.cc:492] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Bootstrap starting.
20:02:57.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.164750 29349 tablet_bootstrap.cc:492] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: No bootstrap required, opened a new log
20:02:57.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.165177 29349 ts_tablet_manager.cc:1403] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.000s
20:02:57.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.165665 29348 tablet_bootstrap.cc:654] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Neither blocks nor log segments found. Creating new log.
20:02:57.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.167001 29348 log.cc:826] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Log is configured to *not* fsync() on all Append() calls
20:02:57.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.168800 29349 raft_consensus.cc:359] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.169205 29349 raft_consensus.cc:385] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:02:57.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.169420 29349 raft_consensus.cc:740] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a78fa230584abfab390a7d0990df73, State: Initialized, Role: FOLLOWER
20:02:57.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.170106 29349 consensus_queue.cc:260] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.171099 29349 ts_tablet_manager.cc:1434] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
20:02:57.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.173580 29351 tablet_bootstrap.cc:492] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Bootstrap starting.
20:02:57.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.175904 29351 tablet_bootstrap.cc:654] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Neither blocks nor log segments found. Creating new log.
20:02:57.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.172312 29318 heartbeater.cc:499] Master 127.27.245.124:40597 was elected leader, sending a full tablet report...
20:02:57.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.176973 29351 log.cc:826] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Log is configured to *not* fsync() on all Append() calls
20:02:57.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.178889 29348 tablet_bootstrap.cc:492] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: No bootstrap required, opened a new log
20:02:57.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.179093 29348 ts_tablet_manager.cc:1403] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.000s
20:02:57.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.182299 29348 raft_consensus.cc:359] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.182690 29348 raft_consensus.cc:385] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:02:57.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.182888 29348 raft_consensus.cc:740] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3038daa93d3a47cca362183b55b674ad, State: Initialized, Role: FOLLOWER
20:02:57.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.183497 29348 consensus_queue.cc:260] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.184753 29348 ts_tablet_manager.cc:1434] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
20:02:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.188555 29351 tablet_bootstrap.cc:492] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: No bootstrap required, opened a new log
20:02:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.188795 29351 ts_tablet_manager.cc:1403] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Time spent bootstrapping tablet: real 0.015s	user 0.002s	sys 0.003s
20:02:57.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.193609 29351 raft_consensus.cc:359] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.193857 29351 raft_consensus.cc:385] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:02:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.193907 29351 raft_consensus.cc:740] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea85607c3d9f4e589d1aaa5eb5435b75, State: Initialized, Role: FOLLOWER
20:02:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.194419 29351 consensus_queue.cc:260] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.195657 29351 ts_tablet_manager.cc:1434] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
20:02:57.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:57.235522 29321 tablet.cc:2406] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:02:57.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:57.307585 29185 tablet.cc:2406] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:02:57.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:57.388329 29048 tablet.cc:2406] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:02:57.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.434494 29352 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:02:57.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.434666 29352 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.435817 29352 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549), 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829)
20:02:57.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.439716 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "36a78fa230584abfab390a7d0990df73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" is_pre_election: true
20:02:57.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.439935 28999 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a78fa230584abfab390a7d0990df73 in term 0.
20:02:57.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.439888 29135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "36a78fa230584abfab390a7d0990df73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3038daa93d3a47cca362183b55b674ad" is_pre_election: true
20:02:57.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.440157 29135 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36a78fa230584abfab390a7d0990df73 in term 0.
20:02:57.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.440379 29205 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a78fa230584abfab390a7d0990df73, ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 
20:02:57.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.440620 29352 raft_consensus.cc:2804] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:02:57.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.440696 29352 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:02:57.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.440768 29352 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 0 FOLLOWER]: Advancing to term 1
20:02:57.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.441633 29352 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.441955 29352 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [CANDIDATE]: Term 1 election: Requested vote from peers ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549), 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829)
20:02:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.442286 28999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "36a78fa230584abfab390a7d0990df73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75"
20:02:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.442391 28999 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 0 FOLLOWER]: Advancing to term 1
20:02:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.442382 29135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "36a78fa230584abfab390a7d0990df73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3038daa93d3a47cca362183b55b674ad"
20:02:57.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.442492 29135 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 0 FOLLOWER]: Advancing to term 1
20:02:57.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.443288 28999 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a78fa230584abfab390a7d0990df73 in term 1.
20:02:57.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.443428 29135 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36a78fa230584abfab390a7d0990df73 in term 1.
20:02:57.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.443557 29205 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a78fa230584abfab390a7d0990df73, ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 
20:02:57.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.443732 29352 raft_consensus.cc:2804] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 1 FOLLOWER]: Leader election won for term 1
20:02:57.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.443956 29352 raft_consensus.cc:697] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [term 1 LEADER]: Becoming Leader. State: Replica: 36a78fa230584abfab390a7d0990df73, State: Running, Role: LEADER
20:02:57.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.444263 29352 consensus_queue.cc:237] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:57.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.447649 28817 catalog_manager.cc:5697] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36a78fa230584abfab390a7d0990df73 (127.27.245.67). New cstate: current_term: 1 leader_uuid: "36a78fa230584abfab390a7d0990df73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } health_report { overall_health: HEALTHY } } }
20:02:57.633 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 58c6f69e7d0346739264583cc6871cd2
20:02:57.648 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 4988e9d699ae4cc2b3ce9579444c3d98 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
20:02:57.664 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299985, tablet=4988e9d699ae4cc2b3ce9579444c3d98@[3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829),36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)[L],ea85607c3d9f4e589d1aaa5eb5435b75(127.27.245.65:34549)]}]
20:02:57.665 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=24), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.245.124:40597, [7ms] Sub RPC GetTableLocations: received response from server master-127.27.245.124:40597: OK, deferred=null) after lookup
20:02:57.673 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] connecting to peer
20:02:57.675 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] Successfully connected to peer
20:02:57.726 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x3bbd4912, L:/127.0.0.1:52598 - R:/127.27.245.67:37081] using TOKEN/null
20:02:57.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.734174 29135 raft_consensus.cc:1275] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Refusing update from remote peer 36a78fa230584abfab390a7d0990df73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:02:57.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.734163 28999 raft_consensus.cc:1275] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Refusing update from remote peer 36a78fa230584abfab390a7d0990df73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:02:57.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.735354 29352 consensus_queue.cc:1048] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:02:57.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.735545 29359 consensus_queue.cc:1048] T 4988e9d699ae4cc2b3ce9579444c3d98 P 36a78fa230584abfab390a7d0990df73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:02:57.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.742738 29364 mvcc.cc:204] Tried to move back new op lower bound from 7305383844790718464 to 7305383843614384128. Current Snapshot: MvccSnapshot[applied={T|T < 7305383844790718464}]
20:02:57.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.750845 29367 mvcc.cc:204] Tried to move back new op lower bound from 7305383844790718464 to 7305383843614384128. Current Snapshot: MvccSnapshot[applied={T|T < 7305383844790718464}]
20:02:57.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.755633 29368 mvcc.cc:204] Tried to move back new op lower bound from 7305383844790718464 to 7305383843614384128. Current Snapshot: MvccSnapshot[applied={T|T < 7305383844790718464}]
20:02:57.873 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=4988e9d699ae4cc2b3ce9579444c3d98, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:02:57.875 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.27.245.124:40597
20:02:57.876 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:02:57.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.876909 28629 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 28783
20:02:57.890 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.27.245.124:40597(127.27.245.124:40597)] handling channelInactive
20:02:57.892 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:02:57.893 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.27.245.67:37081
20:02:57.893 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

20:02:57.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:57.893692 28629 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29189
20:02:57.895 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state READY due to: connection closed
20:02:57.900 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:02:57.900 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] handling channelInactive
20:02:57.900 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] cleaning up while in state READY due to: connection closed
20:02:57.901 [DEBUG - Time-limited test] (Connection.java:748) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] connecting to peer
20:02:57.903 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081): Connection refused: /127.27.245.67:37081
20:02:57.904 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] cleaning up while in state CONNECTING due to: Failed to connect to peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081): Connection refused: /127.27.245.67:37081
20:02:57.904 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081) for tablet 4988e9d699ae4cc2b3ce9579444c3d98: Failed to connect to peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081): Connection refused: /127.27.245.67:37081
20:02:57.908 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:57.910 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.911 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.911 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.27.245.124:40597(127.27.245.124:40597) for tablet Kudu Master: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.929 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:57.931 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.932 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.932 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.935 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:57.949 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:57.951 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.951 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.951 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.952 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:57.969 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:57.971 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.971 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.971 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.971 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:57.988 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:57.991 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.991 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.991 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:57.991 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.008 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:58.010 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.010 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.010 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.012 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.088 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:58.089 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.090 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.090 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.091 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.129 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:58.130 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.130 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.130 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.131 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.149 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:58.150 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.150 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.150 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.151 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.229 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:58.232 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.232 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.232 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.233 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.289 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:58.291 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.291 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.291 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:58.292 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:02:58.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:58.751955 29045 heartbeater.cc:646] Failed to heartbeat to 127.27.245.124:40597 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:58.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:58.755324 29182 heartbeater.cc:646] Failed to heartbeat to 127.27.245.124:40597 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:58.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.951946 29385 raft_consensus.cc:493] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99f30cf0dcf6455e82ecfb9bfb2aa86a)
20:02:58.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.952124 29385 raft_consensus.cc:515] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:58.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.952849 29386 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99f30cf0dcf6455e82ecfb9bfb2aa86a)
20:02:58.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.952944 29386 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:58.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.953259 29385 leader_election.cc:290] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6dceaf50c5a44551be0ad18fe8bc38bf (127.27.245.126:35787), 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597)
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.953698 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6d2f86f39e249ae876036ce302eec5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" is_pre_election: true
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.953759 29386 leader_election.cc:290] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d6d2f86f39e249ae876036ce302eec5e (127.27.245.125:44697), 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597)
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.953851 28680 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6d2f86f39e249ae876036ce302eec5e in term 1.
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.954115 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d6d2f86f39e249ae876036ce302eec5e" is_pre_election: true
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.954227 28754 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dceaf50c5a44551be0ad18fe8bc38bf in term 1.
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.954250 28728 leader_election.cc:304] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf, d6d2f86f39e249ae876036ce302eec5e; no voters: 
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.954456 29385 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Leader pre-election won for term 2
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.954509 29385 raft_consensus.cc:493] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99f30cf0dcf6455e82ecfb9bfb2aa86a)
20:02:58.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.954551 29385 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 1 FOLLOWER]: Advancing to term 2
20:02:58.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:58.954890 28728 leader_election.cc:336] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:58.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.955122 28655 leader_election.cc:304] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf, d6d2f86f39e249ae876036ce302eec5e; no voters: 
20:02:58.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.955715 29386 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Leader pre-election won for term 2
20:02:58.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.955749 29385 raft_consensus.cc:515] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:58.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:58.955875 28655 leader_election.cc:336] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:58.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.956041 29386 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99f30cf0dcf6455e82ecfb9bfb2aa86a)
20:02:58.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.956108 29386 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 1 FOLLOWER]: Advancing to term 2
20:02:58.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.956349 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6d2f86f39e249ae876036ce302eec5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf"
20:02:58.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.956888 29385 leader_election.cc:290] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [CANDIDATE]: Term 2 election: Requested vote from peers 6dceaf50c5a44551be0ad18fe8bc38bf (127.27.245.126:35787), 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597)
20:02:58.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:58.957618 28728 leader_election.cc:336] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:58.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.957881 29386 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:02:58.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.958088 28680 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d6d2f86f39e249ae876036ce302eec5e in current term 2: Already voted for candidate 6dceaf50c5a44551be0ad18fe8bc38bf in this term.
20:02:58.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.958636 28728 leader_election.cc:304] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6d2f86f39e249ae876036ce302eec5e; no voters: 6dceaf50c5a44551be0ad18fe8bc38bf, 99f30cf0dcf6455e82ecfb9bfb2aa86a
20:02:58.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.958652 29386 leader_election.cc:290] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 2 election: Requested vote from peers d6d2f86f39e249ae876036ce302eec5e (127.27.245.125:44697), 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597)
20:02:58.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.959003 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d6d2f86f39e249ae876036ce302eec5e"
20:02:58.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.959052 29385 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:02:58.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.959223 28754 raft_consensus.cc:2393] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6dceaf50c5a44551be0ad18fe8bc38bf in current term 2: Already voted for candidate d6d2f86f39e249ae876036ce302eec5e in this term.
20:02:58.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:58.960084 28655 leader_election.cc:336] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:02:58.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.960150 28655 leader_election.cc:304] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf; no voters: 99f30cf0dcf6455e82ecfb9bfb2aa86a, d6d2f86f39e249ae876036ce302eec5e
20:02:58.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:58.960285 29386 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:02:59.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.331955 29391 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36a78fa230584abfab390a7d0990df73)
20:02:59.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.332074 29391 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:59.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.332803 29392 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 36a78fa230584abfab390a7d0990df73)
20:02:59.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.333096 29392 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.334242 29391 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549), 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:59.334548 29068 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:02:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.334703 29392 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829), 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:59.335671 28932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:02:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:59.335813 29068 leader_election.cc:336] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:02:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:59.336714 28932 leader_election.cc:336] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.337864 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "3038daa93d3a47cca362183b55b674ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" is_pre_election: true
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.337988 28998 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3038daa93d3a47cca362183b55b674ad in term 1.
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338336 29069 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3038daa93d3a47cca362183b55b674ad, ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 36a78fa230584abfab390a7d0990df73
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338356 29135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3038daa93d3a47cca362183b55b674ad" is_pre_election: true
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338548 29135 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea85607c3d9f4e589d1aaa5eb5435b75 in term 1.
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338708 29391 raft_consensus.cc:2804] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Leader pre-election won for term 2
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338769 29391 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36a78fa230584abfab390a7d0990df73)
20:02:59.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338806 29391 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 1 FOLLOWER]: Advancing to term 2
20:02:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.338989 28933 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3038daa93d3a47cca362183b55b674ad, ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 36a78fa230584abfab390a7d0990df73
20:02:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.339377 29392 raft_consensus.cc:2804] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:02:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.339447 29392 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 36a78fa230584abfab390a7d0990df73)
20:02:59.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.339488 29392 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 1 FOLLOWER]: Advancing to term 2
20:02:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.339823 29391 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.340167 29391 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 2 election: Requested vote from peers ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549), 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.340492 29392 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:02:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.340631 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "3038daa93d3a47cca362183b55b674ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75"
20:02:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.340827 28998 raft_consensus.cc:2393] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3038daa93d3a47cca362183b55b674ad in current term 2: Already voted for candidate ea85607c3d9f4e589d1aaa5eb5435b75 in this term.
20:02:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.340883 29392 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [CANDIDATE]: Term 2 election: Requested vote from peers 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829), 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:02:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:59.341346 29068 leader_election.cc:336] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:02:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.341409 29135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3038daa93d3a47cca362183b55b674ad"
20:02:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.341538 29069 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3038daa93d3a47cca362183b55b674ad; no voters: 36a78fa230584abfab390a7d0990df73, ea85607c3d9f4e589d1aaa5eb5435b75
20:02:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.341547 29135 raft_consensus.cc:2393] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ea85607c3d9f4e589d1aaa5eb5435b75 in current term 2: Already voted for candidate 3038daa93d3a47cca362183b55b674ad in this term.
20:02:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.341852 29391 raft_consensus.cc:2749] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:02:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:02:59.342381 28932 leader_election.cc:336] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:02:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.342432 28932 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 3038daa93d3a47cca362183b55b674ad, 36a78fa230584abfab390a7d0990df73
20:02:59.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:02:59.342538 29392 raft_consensus.cc:2749] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:02:59.629 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:02:59.630 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:59.631 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:59.631 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:02:59.632 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:03:00.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.530228 28640 master_runner.cc:187] Error getting master registration for 127.27.245.124:40597: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111), 
20:03:00.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.530377 28640 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:00.649 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:03:00.650 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:03:00.650 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:03:00.651 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:03:00.651 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597; will retry
20:03:00.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.723004 29402 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:00.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.723165 29402 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:03:00.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.723745 29402 leader_election.cc:290] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d6d2f86f39e249ae876036ce302eec5e (127.27.245.125:44697), 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597)
20:03:00.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.724195 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d6d2f86f39e249ae876036ce302eec5e" is_pre_election: true
20:03:00.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:00.724278 28655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111) [suppressed 6 similar messages]
20:03:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.724354 28754 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dceaf50c5a44551be0ad18fe8bc38bf in term 2.
20:03:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.724768 28655 leader_election.cc:304] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf, d6d2f86f39e249ae876036ce302eec5e; no voters: 
20:03:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.724952 29402 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Leader pre-election won for term 3
20:03:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.725004 29402 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.725030 29402 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 2 FOLLOWER]: Advancing to term 3
20:03:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:00.725298 28655 leader_election.cc:336] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:03:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.726186 29402 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:03:00.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.726691 29402 leader_election.cc:290] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 3 election: Requested vote from peers d6d2f86f39e249ae876036ce302eec5e (127.27.245.125:44697), 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597)
20:03:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.727211 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d6d2f86f39e249ae876036ce302eec5e"
20:03:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.727334 28754 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 2 FOLLOWER]: Advancing to term 3
20:03:00.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:00.727743 28655 leader_election.cc:336] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111)
20:03:00.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.728379 28754 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dceaf50c5a44551be0ad18fe8bc38bf in term 3.
20:03:00.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.728680 28655 leader_election.cc:304] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6dceaf50c5a44551be0ad18fe8bc38bf, d6d2f86f39e249ae876036ce302eec5e; no voters: 99f30cf0dcf6455e82ecfb9bfb2aa86a
20:03:00.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.728855 29402 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 3 FOLLOWER]: Leader election won for term 3
20:03:00.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.729008 29402 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [term 3 LEADER]: Becoming Leader. State: Replica: 6dceaf50c5a44551be0ad18fe8bc38bf, State: Running, Role: LEADER
20:03:00.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.729259 29402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } }
20:03:00.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.730134 29402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dceaf50c5a44551be0ad18fe8bc38bf. Latest consensus state: current_term: 3 leader_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:03:00.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.730293 29402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: This master's current role is: LEADER
20:03:00.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.730732 29406 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
20:03:00.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.732471 29406 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2]
20:03:00.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.733577 29406 tablet_loader.cc:96] loaded metadata for tablet 4988e9d699ae4cc2b3ce9579444c3d98 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2])
20:03:00.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.733726 29406 catalog_manager.cc:1520] Initializing Kudu cluster ID...
20:03:00.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.734113 29406 catalog_manager.cc:1295] Loaded cluster ID: 6da5fa87406f477a84faffe157eb6c77
20:03:00.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.734166 29406 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
20:03:00.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.734756 29406 catalog_manager.cc:1540] Loading token signing keys...
20:03:00.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.735152 29406 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: Loaded TSK: 0
20:03:00.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:00.735898 29406 catalog_manager.cc:1550] Initializing in-progress tserver states...
20:03:01.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:01.132674 28655 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf -> Peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Couldn't send request to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:03:01.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.213977 28754 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [term 3 FOLLOWER]: Refusing update from remote peer 6dceaf50c5a44551be0ad18fe8bc38bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
20:03:01.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.214578 29404 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
20:03:01.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.215854 29409 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dceaf50c5a44551be0ad18fe8bc38bf. Latest consensus state: current_term: 3 leader_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:03:01.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.215956 29409 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: This master's current role is: FOLLOWER
20:03:01.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.217113 29402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:03:01.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.217257 29402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf [sys.catalog]: This master's current role is: LEADER
20:03:01.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.217428 29409 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dceaf50c5a44551be0ad18fe8bc38bf" member_type: VOTER last_known_addr { host: "127.27.245.126" port: 35787 } } peers { permanent_uuid: "d6d2f86f39e249ae876036ce302eec5e" member_type: VOTER last_known_addr { host: "127.27.245.125" port: 44697 } } peers { permanent_uuid: "99f30cf0dcf6455e82ecfb9bfb2aa86a" member_type: VOTER last_known_addr { host: "127.27.245.124" port: 40597 } } }
20:03:01.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.217538 29409 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6d2f86f39e249ae876036ce302eec5e [sys.catalog]: This master's current role is: FOLLOWER
20:03:01.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.364706 29413 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:01.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.364872 29413 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:03:01.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.365329 29413 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549), 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.365864 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "3038daa93d3a47cca362183b55b674ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" is_pre_election: true
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.366016 28998 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3038daa93d3a47cca362183b55b674ad in term 2.
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.366400 29069 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3038daa93d3a47cca362183b55b674ad, ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.366569 29413 raft_consensus.cc:2804] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Leader pre-election won for term 3
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.366618 29413 raft_consensus.cc:493] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.366647 29413 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 2 FOLLOWER]: Advancing to term 3
20:03:01.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:01.366722 29068 leader_election.cc:336] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:03:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.367501 29413 raft_consensus.cc:515] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:03:01.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.367820 29413 leader_election.cc:290] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 3 election: Requested vote from peers ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549), 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081)
20:03:01.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.368142 28998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988e9d699ae4cc2b3ce9579444c3d98" candidate_uuid: "3038daa93d3a47cca362183b55b674ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75"
20:03:01.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.368259 28998 raft_consensus.cc:3060] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 2 FOLLOWER]: Advancing to term 3
20:03:01.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:01.369149 29068 leader_election.cc:336] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:03:01.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.369351 28998 raft_consensus.cc:2468] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3038daa93d3a47cca362183b55b674ad in term 3.
20:03:01.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.369679 29069 leader_election.cc:304] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3038daa93d3a47cca362183b55b674ad, ea85607c3d9f4e589d1aaa5eb5435b75; no voters: 36a78fa230584abfab390a7d0990df73
20:03:01.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.369858 29413 raft_consensus.cc:2804] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 3 FOLLOWER]: Leader election won for term 3
20:03:01.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.370034 29413 raft_consensus.cc:697] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 3 LEADER]: Becoming Leader. State: Replica: 3038daa93d3a47cca362183b55b674ad, State: Running, Role: LEADER
20:03:01.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.370429 29413 consensus_queue.cc:237] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } }
20:03:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.372149 29183 heartbeater.cc:499] Master 127.27.245.126:35787 was elected leader, sending a full tablet report...
20:03:01.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.373728 28670 catalog_manager.cc:5697] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad reported cstate change: term changed from 1 to 3, leader changed from 36a78fa230584abfab390a7d0990df73 (127.27.245.67) to 3038daa93d3a47cca362183b55b674ad (127.27.245.66). New cstate: current_term: 3 leader_uuid: "3038daa93d3a47cca362183b55b674ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3038daa93d3a47cca362183b55b674ad" member_type: VOTER last_known_addr { host: "127.27.245.66" port: 33829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a78fa230584abfab390a7d0990df73" member_type: VOTER last_known_addr { host: "127.27.245.67" port: 37081 } health_report { overall_health: UNKNOWN } } }
20:03:01.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.755081 29046 heartbeater.cc:499] Master 127.27.245.126:35787 was elected leader, sending a full tablet report...
20:03:01.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:01.756896 29068 consensus_peers.cc:597] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad -> Peer 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): Couldn't send request to peer 36a78fa230584abfab390a7d0990df73. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:03:01.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.857136 28998 raft_consensus.cc:1275] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 3 FOLLOWER]: Refusing update from remote peer 3038daa93d3a47cca362183b55b674ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
20:03:01.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:01.857707 29413 consensus_queue.cc:1048] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea85607c3d9f4e589d1aaa5eb5435b75" member_type: VOTER last_known_addr { host: "127.27.245.65" port: 34549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
20:03:03.669 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.27.245.124:40597(127.27.245.124:40597)] connecting to peer
20:03:03.670 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:03:03.671 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.27.245.124:40597(127.27.245.124:40597)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:03:03.671 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.27.245.124:40597: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597
20:03:03.672 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:03:03.674 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=14, TimeoutTracker(timeout=29993, elapsed=5764), Traces: [0ms] sending RPC to server master-127.27.245.124:40597, [3ms] received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [23ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [28ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [43ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [44ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [44ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [62ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [64ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [79ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [83ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [83ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [99ms] refreshing cache from master, [99ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [102ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [103ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [104ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [182ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [183ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [183ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [183ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [219ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [222ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [223ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [239ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [242ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [243ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [243ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [320ms] refreshing cache from master, [320ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [321ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [323ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [324ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [325ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [380ms] refreshing cache from master, [380ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [383ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [384ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [1720ms] refreshing cache from master, [1720ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [1721ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [1723ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [1724ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [1724ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [2740ms] refreshing cache from master, [2740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [2740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [2740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [2742ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [2742ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [2743ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [2743ms] delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [5760ms] refreshing cache from master, [5760ms] too many traces: truncated at 100 traces, deferred=Deferred@516852478(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@711241852 after retry RPC after error@1021783039) -> (continuation of Deferred@1488828022 after retry RPC after error@843996901) -> (continuation of Deferred@1025961856 after retry RPC after error@949719816) -> (continuation of Deferred@220236907 after retry RPC after error@1306083932) -> (continuation of Deferred@1191837320 after retry RPC after error@594425522) -> (continuation of Deferred@707048800 after retry RPC after error@761842138) -> (continuation of Deferred@622694209 after retry RPC after error@1997858550) -> (continuation of Deferred@2014630593 after retry RPC after error@324661760) -> (continuation of Deferred@1517748397 after retry RPC after error@176451139) -> (continuation of Deferred@1415067400 after retry RPC after error@147654257) -> (continuation of Deferred@1792875949 after retry RPC after error@1124241603) -> (continuation of Deferred@1450643420 after retry RPC after error@921265645), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@711241852 after retry RPC after error@1021783039) -> (continuation of Deferred@1488828022 after retry RPC after error@843996901) -> (continuation of Deferred@1025961856 after retry RPC after error@949719816) -> (continuation of Deferred@220236907 after retry RPC after error@1306083932) -> (continuation of Deferred@1191837320 after retry RPC after error@594425522) -> (continuation of Deferred@707048800 after retry RPC after error@761842138) -> (continuation of Deferred@622694209 after retry RPC after error@1997858550) -> (continuation of Deferred@2014630593 after retry RPC after error@324661760) -> (continuation of Deferred@1517748397 after retry RPC after error@176451139) -> (continuation of Deferred@1415067400 after retry RPC after error@147654257) -> (continuation of Deferred@1792875949 after retry RPC after error@1124241603) -> (continuation of Deferred@1450643420 after retry RPC after error@921265645))) after lookup
20:03:03.678 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 4988e9d699ae4cc2b3ce9579444c3d98 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
20:03:03.678 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=4988e9d699ae4cc2b3ce9579444c3d98@[3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829)[L],36a78fa230584abfab390a7d0990df73(127.27.245.67:37081),ea85607c3d9f4e589d1aaa5eb5435b75(127.27.245.65:34549)]}]
20:03:03.679 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=4988e9d699ae4cc2b3ce9579444c3d98, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=5777), Traces: [0ms] sending RPC to server 36a78fa230584abfab390a7d0990df73, [3ms] received response from server 36a78fa230584abfab390a7d0990df73: Network error: Failed to connect to peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081): Connection refused: /127.27.245.67:37081, [3ms] delaying RPC due to: Network error: Failed to connect to peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081): Connection refused: /127.27.245.67:37081, [7ms] refreshing cache from master, [7ms] Sub RPC GetTableLocations: sending RPC to server master-127.27.245.124:40597, [10ms] Sub RPC GetTableLocations: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [10ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [27ms] Sub RPC GetTableLocations: refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [30ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [31ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [35ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [47ms] Sub RPC GetTableLocations: refreshing cache from master, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [47ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [50ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [50ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [51ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [51ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [67ms] Sub RPC GetTableLocations: refreshing cache from master, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [67ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [69ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [70ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [70ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [71ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [86ms] Sub RPC GetTableLocations: refreshing cache from master, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [89ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [89ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [90ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [90ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [106ms] Sub RPC GetTableLocations: refreshing cache from master, [106ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [109ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [110ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [111ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [111ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [186ms] Sub RPC GetTableLocations: refreshing cache from master, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [187ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [189ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [190ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [190ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [190ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [226ms] Sub RPC GetTableLocations: refreshing cache from master, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [227ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [229ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [230ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [246ms] Sub RPC GetTableLocations: refreshing cache from master, [247ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [247ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [247ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [249ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [249ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [250ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [250ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [327ms] Sub RPC GetTableLocations: refreshing cache from master, [327ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [328ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [328ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [330ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [330ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [331ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [332ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [387ms] Sub RPC GetTableLocations: refreshing cache from master, [387ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [388ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [390ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [390ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [390ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [391ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [1727ms] Sub RPC GetTableLocations: refreshing cache from master, [1727ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [1728ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [1728ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [1730ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [1730ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.126:35787: OK, [1731ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.125:44697: OK, [1731ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.27.245.125:44697,127.27.245.126:35787,127.27.245.124:40597) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [2747ms] Sub RPC GetTableLocations: refreshing cache from master, [2747ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.125:44697, [2747ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.126:35787, [2747ms] Sub RPC ConnectToMaster: sending RPC to server master-127.27.245.124:40597, [2749ms] Sub RPC ConnectToMaster: received response from server master-127.27.245.124:40597: Network error: Failed to connect to peer master-127.27.245.124:40597(127.27.245.124:40597): Connection refused: /127.27.245.124:40597, [2749ms] too many traces: truncated at 100 traces, deferred=Deferred@1669872680(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@defd66a -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@70d41c37 -> wakeup thread Time-limited test)) after lookup
20:03:03.681 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829)] connecting to peer
20:03:03.682 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829)] Successfully connected to peer
20:03:03.700 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x355d1193, L:/127.0.0.1:58622 - R:/127.27.245.66:33829] using TOKEN/null
20:03:03.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:03.762843 28655 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf -> Peer 99f30cf0dcf6455e82ecfb9bfb2aa86a (127.27.245.124:40597): Couldn't send request to peer 99f30cf0dcf6455e82ecfb9bfb2aa86a. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.124:40597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
20:03:03.777 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=4988e9d699ae4cc2b3ce9579444c3d98, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:03:03.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.782398 28671 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45676:
20:03:03.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
20:03:03.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.782603 28671 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45676:
20:03:03.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
20:03:03.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.787693 28671 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 6dceaf50c5a44551be0ad18fe8bc38bf: Sending DeleteTablet for 3 replicas of tablet 4988e9d699ae4cc2b3ce9579444c3d98
20:03:03.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:03.796303 28655 catalog_manager.cc:4755] TS 36a78fa230584abfab390a7d0990df73 (127.27.245.67:37081): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4988e9d699ae4cc2b3ce9579444c3d98: Network error: Client connection negotiation failed: client connection to 127.27.245.67:37081: connect: Connection refused (error 111)
20:03:03.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.798055 29115 tablet_service.cc:1558] Processing DeleteTablet for tablet 4988e9d699ae4cc2b3ce9579444c3d98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 20:03:03 UTC) from {username='slave'} at 127.0.0.1:58632
20:03:03.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.798564 29459 tablet_replica.cc:333] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: stopping tablet replica
20:03:03.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.799046 29459 raft_consensus.cc:2243] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 3 LEADER]: Raft consensus shutting down.
20:03:03.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.799611 29459 raft_consensus.cc:2272] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad [term 3 FOLLOWER]: Raft consensus is shut down!
20:03:03.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.801075 29459 ts_tablet_manager.cc:1916] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Deleting tablet data with delete state TABLET_DATA_DELETED
20:03:03.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.803736 29459 ts_tablet_manager.cc:1929] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.22
20:03:03.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.803972 29459 log.cc:1199] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Deleting WAL directory at /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-1/wal/wals/4988e9d699ae4cc2b3ce9579444c3d98
20:03:03.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.804481 28979 tablet_service.cc:1558] Processing DeleteTablet for tablet 4988e9d699ae4cc2b3ce9579444c3d98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 20:03:03 UTC) from {username='slave'} at 127.0.0.1:49982
20:03:03.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.805079 29459 ts_tablet_manager.cc:1950] T 4988e9d699ae4cc2b3ce9579444c3d98 P 3038daa93d3a47cca362183b55b674ad: Deleting consensus metadata
20:03:03.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.806437 28656 catalog_manager.cc:5028] TS 3038daa93d3a47cca362183b55b674ad (127.27.245.66:33829): tablet 4988e9d699ae4cc2b3ce9579444c3d98 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2]) successfully deleted
20:03:03.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.806556 29460 tablet_replica.cc:333] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: stopping tablet replica
20:03:03.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.806818 29460 raft_consensus.cc:2243] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 3 FOLLOWER]: Raft consensus shutting down.
20:03:03.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.807072 29460 raft_consensus.cc:2272] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75 [term 3 FOLLOWER]: Raft consensus is shut down!
20:03:03.809 [DEBUG - main] (Connection.java:575) [peer 36a78fa230584abfab390a7d0990df73(127.27.245.67:37081)] disconnecting while in state TERMINATED
20:03:03.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.809829 29460 ts_tablet_manager.cc:1916] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Deleting tablet data with delete state TABLET_DATA_DELETED
20:03:03.810 [DEBUG - main] (Connection.java:575) [peer master-127.27.245.126:35787(127.27.245.126:35787)] disconnecting while in state READY
20:03:03.811 [DEBUG - main] (Connection.java:575) [peer master-127.27.245.125:44697(127.27.245.125:44697)] disconnecting while in state READY
20:03:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.812922 29460 ts_tablet_manager.cc:1929] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.22
20:03:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.813148 29460 log.cc:1199] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Deleting WAL directory at /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13352281281725971357/ts-0/wal/wals/4988e9d699ae4cc2b3ce9579444c3d98
20:03:03.813 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.27.245.125:44697(127.27.245.125:44697)] handling channelInactive
20:03:03.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.813591 29460 ts_tablet_manager.cc:1950] T 4988e9d699ae4cc2b3ce9579444c3d98 P ea85607c3d9f4e589d1aaa5eb5435b75: Deleting consensus metadata
20:03:03.813 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.27.245.125:44697(127.27.245.125:44697)] cleaning up while in state READY due to: connection closed
20:03:03.814 [DEBUG - main] (Connection.java:575) [peer 3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829)] disconnecting while in state READY
20:03:03.815 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829)] handling channelInactive
20:03:03.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.815131 28656 catalog_manager.cc:5028] TS ea85607c3d9f4e589d1aaa5eb5435b75 (127.27.245.65:34549): tablet 4988e9d699ae4cc2b3ce9579444c3d98 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=58c6f69e7d0346739264583cc6871cd2]) successfully deleted
20:03:03.815 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 3038daa93d3a47cca362183b55b674ad(127.27.245.66:33829)] cleaning up while in state READY due to: connection closed
20:03:03.815 [DEBUG - main] (Connection.java:575) [peer master-127.27.245.124:40597(127.27.245.124:40597)] disconnecting while in state TERMINATED
20:03:03.817 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:03:03.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.820129 28629 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 28917
20:03:03.825 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.27.245.126:35787(127.27.245.126:35787)] handling channelInactive
20:03:03.825 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.27.245.126:35787(127.27.245.126:35787)] cleaning up while in state READY due to: connection closed
20:03:03.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.827811 28629 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29052
20:03:03.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.833828 28629 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 28640
20:03:03.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:03.839480 28629 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 28712
20:03:03.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T20:03:03Z chronyd exiting
.20:03:04.097 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783540984097
20:03:04.100 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:03:04.101 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:03:04.101 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskCEZtFK/test-tmp
20:03:04.101 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/debug/bin
20:03:04.101 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskCEZtFK/java/build/dist-test/../../../build/debug/bin/kudu, test, mini_cluster, --serialization=pb]
20:03:04.103 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:03:04.200 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:03:04.201 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:03:04.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.202371 29464 mini_oidc.cc:150] Starting JWKS server
20:03:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.203722 29464 webserver.cc:533] Webserver started at http://127.0.0.1:36623/ using document root <none> and password file <none>
20:03:04.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.203837 29464 mini_oidc.cc:186] Starting OIDC Discovery server
20:03:04.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.204041 29464 webserver.cc:533] Webserver started at http://127.0.0.1:36739/ using document root <none> and password file <none>
20:03:04.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T20:03:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:03:04.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T20:03:04Z Disabled control of system clock
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.216888 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/logs
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data/info.pb
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.62:44055
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.62
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json with env {}
20:03:04.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.312762 29475 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:04.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.312940 29475 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:04.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.312983 29475 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:04.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.316118 29475 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:04.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.316161 29475 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:04.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.316179 29475 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:04.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.316195 29475 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:04.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.316210 29475 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:04.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.316222 29475 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36623/jwks.json
20:03:04.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.319772 29475 master_runner.cc:387] Master server non-default flags:
20:03:04.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.62:44055
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data/info.pb
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.62
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29475
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:04.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/logs
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:04.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.320812 29475 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:04.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.322115 29475 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:04.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.327989 29480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.328018 29481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.328269 29483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.328832 29475 server_base.cc:1061] running on GCE node
20:03:04.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.329314 29475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:04.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.330174 29475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:04.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.331354 29475 hybrid_clock.cc:648] HybridClock initialized: now 1783540984331346 us; error 26 us; skew 500 ppm
20:03:04.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.333079 29475 webserver.cc:533] Webserver started at http://127.28.198.62:40479/ using document root <none> and password file <none>
20:03:04.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.333597 29475 fs_manager.cc:362] Metadata directory not provided
20:03:04.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.333678 29475 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:04.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.333905 29475 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:04.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.335280 29475 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data/instance:
20:03:04.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48a88b821ddd4fc4accf3b93d8f2a36d"
20:03:04.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.335776 29475 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal/instance:
20:03:04.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48a88b821ddd4fc4accf3b93d8f2a36d"
20:03:04.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.338868 29475 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
20:03:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.340941 29489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.341763 29475 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.341904 29475 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48a88b821ddd4fc4accf3b93d8f2a36d"
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.342037 29475 fs_report.cc:389] FS layout report
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data/data
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:04.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.354858 29475 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:04.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.355429 29475 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:04.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.355625 29475 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.362464 29541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.62:44055 every 8 connection(s)
20:03:04.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.362468 29475 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.62:44055
20:03:04.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.363430 29475 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/data/info.pb
20:03:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.366056 29542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:04.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.369196 29542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.371677 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29475
20:03:04.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.371816 29464 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-0/wal/instance
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.373327 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/logs
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data/info.pb
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.61:41219
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.61
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json with env {}
20:03:04.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.378919 29542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.379551 29490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.198.61:41219: connect: Connection refused (error 111)
20:03:04.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.380326 29542 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.61:41219: Network error: Client connection negotiation failed: client connection to 127.28.198.61:41219: connect: Connection refused (error 111)
20:03:04.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.429566 29542 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } attempt: 1
20:03:04.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.431183 29542 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.61:41219: Network error: Client connection negotiation failed: client connection to 127.28.198.61:41219: connect: Connection refused (error 111)
20:03:04.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.470690 29546 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:04.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.470885 29546 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:04.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.470929 29546 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:04.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.474104 29546 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:04.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.474167 29546 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:04.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.474186 29546 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:04.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.474203 29546 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:04.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.474220 29546 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:04.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.474233 29546 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36623/jwks.json
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.477978 29546 master_runner.cc:387] Master server non-default flags:
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.61:41219
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data/info.pb
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.61
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29546
20:03:04.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/logs
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.478889 29546 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:04.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.479956 29546 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.484917 29552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.484932 29555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.484967 29553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.485198 29546 server_base.cc:1061] running on GCE node
20:03:04.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.485564 29546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:04.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.486378 29546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:04.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.487532 29546 hybrid_clock.cc:648] HybridClock initialized: now 1783540984487518 us; error 29 us; skew 500 ppm
20:03:04.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.489073 29546 webserver.cc:533] Webserver started at http://127.28.198.61:38219/ using document root <none> and password file <none>
20:03:04.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.489564 29546 fs_manager.cc:362] Metadata directory not provided
20:03:04.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.489629 29546 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:04.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.489769 29546 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.491137 29546 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data/instance:
20:03:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7e53affeac6148caaa5179e2f3e9b7f3"
20:03:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.491540 29546 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal/instance:
20:03:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7e53affeac6148caaa5179e2f3e9b7f3"
20:03:04.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.494887 29546 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
20:03:04.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.496646 29561 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.497555 29546 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.497679 29546 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7e53affeac6148caaa5179e2f3e9b7f3"
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.497769 29546 fs_report.cc:389] FS layout report
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal
20:03:04.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data/data
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:04.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:04.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.499364 29542 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } attempt: 2
20:03:04.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.500689 29542 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.61:41219: Network error: Client connection negotiation failed: client connection to 127.28.198.61:41219: connect: Connection refused (error 111)
20:03:04.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.508924 29546 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:04.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.509413 29546 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:04.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.509536 29546 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:04.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.516044 29546 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.61:41219
20:03:04.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.516050 29613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.61:41219 every 8 connection(s)
20:03:04.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.517081 29546 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/data/info.pb
20:03:04.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.518056 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29546
20:03:04.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.518173 29464 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-1/wal/instance
20:03:04.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.518829 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/logs
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/info.pb
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.60:34329
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.60
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json with env {}
20:03:04.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.519562 29614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:04.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.523384 29614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.532837 29614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.538691 29614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.539356 29565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.198.60:34329: connect: Connection refused (error 111)
20:03:04.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.540234 29614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.60:34329: Network error: Client connection negotiation failed: client connection to 127.28.198.60:34329: connect: Connection refused (error 111)
20:03:04.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.589448 29614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } attempt: 1
20:03:04.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.591061 29614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.60:34329: Network error: Client connection negotiation failed: client connection to 127.28.198.60:34329: connect: Connection refused (error 111)
20:03:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.591876 29542 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } attempt: 3
20:03:04.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.596140 29542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.597543 29542 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.60:34329: Network error: Client connection negotiation failed: client connection to 127.28.198.60:34329: connect: Connection refused (error 111)
20:03:04.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.624032 29616 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:04.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.624225 29616 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:04.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.624267 29616 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.627395 29616 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.627444 29616 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.627463 29616 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.627480 29616 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.627496 29616 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:04.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.627511 29616 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36623/jwks.json
20:03:04.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.628777 29542 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } attempt: 1
20:03:04.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.630093 29542 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.60:34329: Network error: Client connection negotiation failed: client connection to 127.28.198.60:34329: connect: Connection refused (error 111)
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.632565 29616 master_runner.cc:387] Master server non-default flags:
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.60:34329
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/info.pb
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.60
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29616
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/logs
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:04.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.633719 29616 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:04.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.634972 29616 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:04.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.639920 29624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.639930 29625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.639923 29627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.640237 29616 server_base.cc:1061] running on GCE node
20:03:04.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.640591 29616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:04.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.641414 29616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:04.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.642556 29616 hybrid_clock.cc:648] HybridClock initialized: now 1783540984642545 us; error 30 us; skew 500 ppm
20:03:04.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.644102 29616 webserver.cc:533] Webserver started at http://127.28.198.60:36607/ using document root <none> and password file <none>
20:03:04.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.644543 29616 fs_manager.cc:362] Metadata directory not provided
20:03:04.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.644590 29616 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:04.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.644724 29616 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.646070 29616 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/instance:
20:03:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd8ca914b4a2437fa0bc2efb0faf8842"
20:03:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.646618 29616 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal/instance:
20:03:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd8ca914b4a2437fa0bc2efb0faf8842"
20:03:04.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.649521 29616 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
20:03:04.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.651363 29633 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.652252 29616 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.652343 29616 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd8ca914b4a2437fa0bc2efb0faf8842"
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.652410 29616 fs_report.cc:389] FS layout report
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/data
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:04.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:04.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.659322 29614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } attempt: 2
20:03:04.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.660701 29614 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.198.60:34329: Network error: Client connection negotiation failed: client connection to 127.28.198.60:34329: connect: Connection refused (error 111)
20:03:04.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.661980 29616 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:04.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.662456 29616 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:04.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.662612 29616 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:04.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.668922 29616 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.60:34329
20:03:04.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.668931 29685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.60:34329 every 8 connection(s)
20:03:04.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.669737 29616 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/info.pb
20:03:04.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.672178 29686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:04.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.675243 29686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.677000 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29616
20:03:04.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.677134 29464 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal/instance
20:03:04.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.683911 29686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.687988 29686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } has no permanent_uuid. Determining permanent_uuid...
20:03:04.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.695170 29686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Bootstrap starting.
20:03:04.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.697196 29686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Neither blocks nor log segments found. Creating new log.
20:03:04.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.697784 29686 log.cc:826] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Log is configured to *not* fsync() on all Append() calls
20:03:04.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.699344 29686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: No bootstrap required, opened a new log
20:03:04.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.702057 29686 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.702236 29686 raft_consensus.cc:385] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:04.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.702348 29686 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd8ca914b4a2437fa0bc2efb0faf8842, State: Initialized, Role: FOLLOWER
20:03:04.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.702782 29686 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.703356 29695 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.703454 29695 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.704002 29686 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: configured and running, proceeding with master startup.
20:03:04.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.705235 29542 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } attempt: 2
20:03:04.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.708948 29706 catalog_manager.cc:1594] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:04.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.709167 29706 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:04.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.707274 29616 master_runner.cc:187] Error getting master registration for 127.28.198.62:44055: OK, instance_id { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" instance_seqno: 1783540984360615 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:04.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.709802 29616 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:04.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.711424 29542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: Bootstrap starting.
20:03:04.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.713351 29542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: Neither blocks nor log segments found. Creating new log.
20:03:04.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.713907 29542 log.cc:826] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: Log is configured to *not* fsync() on all Append() calls
20:03:04.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.715212 29542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: No bootstrap required, opened a new log
20:03:04.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.717826 29542 raft_consensus.cc:359] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.717995 29542 raft_consensus.cc:385] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:04.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.718045 29542 raft_consensus.cc:740] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a88b821ddd4fc4accf3b93d8f2a36d, State: Initialized, Role: FOLLOWER
20:03:04.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.718461 29542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.718884 29709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.718974 29709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.719441 29542 sys_catalog.cc:565] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: configured and running, proceeding with master startup.
20:03:04.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.723778 29720 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:04.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.723990 29720 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:04.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.723707 29475 master_runner.cc:187] Error getting master registration for 127.28.198.61:41219: OK, instance_id { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" instance_seqno: 1783540984514316 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:04.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.725793 29475 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:04.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.751904 29614 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } attempt: 3
20:03:04.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.759430 29614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: Bootstrap starting.
20:03:04.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.762192 29614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: Neither blocks nor log segments found. Creating new log.
20:03:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.763013 29614 log.cc:826] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: Log is configured to *not* fsync() on all Append() calls
20:03:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.764899 29614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: No bootstrap required, opened a new log
20:03:04.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.768152 29614 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.768332 29614 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:04.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.768379 29614 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e53affeac6148caaa5179e2f3e9b7f3, State: Initialized, Role: FOLLOWER
20:03:04.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.768852 29614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.769289 29723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.769541 29723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.771158 29614 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: configured and running, proceeding with master startup.
20:03:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.775836 29734 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:04.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.776046 29734 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:04.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.778844 29546 master_runner.cc:264] No leader master found from master 7e53affeac6148caaa5179e2f3e9b7f3
20:03:04.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.778900 29546 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:04.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.856863 29495 tablet.cc:2406] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:04.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:04.913622 29639 tablet.cc:2406] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:04.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.932183 29695 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:04.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.932360 29695 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.933425 29695 leader_election.cc:290] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a88b821ddd4fc4accf3b93d8f2a36d (127.28.198.62:44055), 7e53affeac6148caaa5179e2f3e9b7f3 (127.28.198.61:41219)
20:03:04.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.934060 29588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" is_pre_election: true
20:03:04.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.934336 29588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd8ca914b4a2437fa0bc2efb0faf8842 in term 0.
20:03:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.934764 29634 leader_election.cc:304] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e53affeac6148caaa5179e2f3e9b7f3, cd8ca914b4a2437fa0bc2efb0faf8842; no voters: 
20:03:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.934943 29516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" is_pre_election: true
20:03:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.935145 29516 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd8ca914b4a2437fa0bc2efb0faf8842 in term 0.
20:03:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.935737 29695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:03:04.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.935798 29695 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:04.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.935832 29695 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 0 FOLLOWER]: Advancing to term 1
20:03:04.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.936780 29695 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.937103 29695 leader_election.cc:290] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [CANDIDATE]: Term 1 election: Requested vote from peers 48a88b821ddd4fc4accf3b93d8f2a36d (127.28.198.62:44055), 7e53affeac6148caaa5179e2f3e9b7f3 (127.28.198.61:41219)
20:03:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.937466 29588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e53affeac6148caaa5179e2f3e9b7f3"
20:03:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.937552 29516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d"
20:03:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.937580 29588 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 0 FOLLOWER]: Advancing to term 1
20:03:04.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.937660 29516 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 0 FOLLOWER]: Advancing to term 1
20:03:04.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.938521 29516 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd8ca914b4a2437fa0bc2efb0faf8842 in term 1.
20:03:04.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.938666 29588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd8ca914b4a2437fa0bc2efb0faf8842 in term 1.
20:03:04.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.938877 29635 leader_election.cc:304] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a88b821ddd4fc4accf3b93d8f2a36d, cd8ca914b4a2437fa0bc2efb0faf8842; no voters: 
20:03:04.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.939026 29695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Leader election won for term 1
20:03:04.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.939239 29695 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 LEADER]: Becoming Leader. State: Replica: cd8ca914b4a2437fa0bc2efb0faf8842, State: Running, Role: LEADER
20:03:04.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.939517 29695 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:04.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.941529 29736 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd8ca914b4a2437fa0bc2efb0faf8842. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.941642 29736 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: LEADER
20:03:04.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.942117 29738 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
20:03:04.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.943224 29738 catalog_manager.cc:1520] Initializing Kudu cluster ID...
20:03:04.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.947134 29516 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Refusing update from remote peer cd8ca914b4a2437fa0bc2efb0faf8842: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:04.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.947180 29588 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 1 FOLLOWER]: Refusing update from remote peer cd8ca914b4a2437fa0bc2efb0faf8842: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:04.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.947742 29736 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:04.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.947921 29695 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:04.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.951279 29709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd8ca914b4a2437fa0bc2efb0faf8842. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.951378 29709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.951619 29723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd8ca914b4a2437fa0bc2efb0faf8842. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.951732 29723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.953622 29736 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.953715 29736 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: LEADER
20:03:04.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.954638 29723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.954734 29723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.954741 29741 mvcc.cc:204] Tried to move back new op lower bound from 7305383874337673216 to 7305383874315112448. Current Snapshot: MvccSnapshot[applied={T|T < 7305383874337673216}]
20:03:04.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.956239 29709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.956331 29709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: This master's current role is: FOLLOWER
20:03:04.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.955428 29746 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:04.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.957002 29738 catalog_manager.cc:1383] Generated new cluster ID: 4214ff1abb174f6aa619f9e82e056bb5
20:03:04.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.957051 29738 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
20:03:04.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.958173 29746 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: LEADER
20:03:04.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.971122 29738 catalog_manager.cc:1406] Generated new certificate authority record
20:03:04.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.972481 29738 catalog_manager.cc:1540] Loading token signing keys...
20:03:04.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.981436 29738 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Generated new TSK 0
20:03:04.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:04.982232 29738 catalog_manager.cc:1550] Initializing in-progress tserver states...
20:03:05.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.006537 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/logs
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data/info.pb
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.1:0
20:03:05.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.198.1
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.1
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:05.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.105681 29748 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:05.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.105880 29748 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:05.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.105934 29748 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:05.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.109382 29748 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:05.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.109519 29748 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.198.1
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.113286 29748 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.1:0
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data/info.pb
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.1
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29748
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.198.1
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/logs
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:05.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.114467 29748 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:05.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.115538 29748 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:05.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.121570 29756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.121575 29753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.121575 29754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.122134 29748 server_base.cc:1061] running on GCE node
20:03:05.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.122411 29748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:05.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.122825 29748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:05.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.123996 29748 hybrid_clock.cc:648] HybridClock initialized: now 1783540985123982 us; error 27 us; skew 500 ppm
20:03:05.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.125659 29748 webserver.cc:533] Webserver started at http://127.28.198.1:45811/ using document root <none> and password file <none>
20:03:05.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.126209 29748 fs_manager.cc:362] Metadata directory not provided
20:03:05.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.126291 29748 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:05.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.126524 29748 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.128021 29748 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data/instance:
20:03:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "613ccbdd24e74bd09dd252d758ea41ef"
20:03:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.128533 29748 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal/instance:
20:03:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "613ccbdd24e74bd09dd252d758ea41ef"
20:03:05.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.131618 29748 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
20:03:05.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.133713 29762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.134568 29748 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
20:03:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.134684 29748 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal
20:03:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "613ccbdd24e74bd09dd252d758ea41ef"
20:03:05.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.134799 29748 fs_report.cc:389] FS layout report
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data/data
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:05.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.149178 29748 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:05.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.149847 29748 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:05.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.150046 29748 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:05.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.150637 29748 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:05.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.151690 29748 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:05.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.151762 29748 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:03:05.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.151819 29748 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:05.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.151842 29748 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.160962 29748 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.1:38699
20:03:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.161001 29875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.1:38699 every 8 connection(s)
20:03:05.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.161913 29748 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/data/info.pb
20:03:05.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.162176 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29748
20:03:05.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.162284 29464 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-0/wal/instance
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.166280 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/logs
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data/info.pb
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:05.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.2:0
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.198.2
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.2
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:05.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.171695 29876 heartbeater.cc:344] Connected to a master server at 127.28.198.62:44055
20:03:05.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.171761 29877 heartbeater.cc:344] Connected to a master server at 127.28.198.60:34329
20:03:05.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.171928 29876 heartbeater.cc:461] Registering TS with master...
20:03:05.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.171720 29878 heartbeater.cc:344] Connected to a master server at 127.28.198.61:41219
20:03:05.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.172006 29878 heartbeater.cc:461] Registering TS with master...
20:03:05.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.171928 29877 heartbeater.cc:461] Registering TS with master...
20:03:05.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.172473 29878 heartbeater.cc:507] Master 127.28.198.61:41219 requested a full tablet report, sending...
20:03:05.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.172473 29876 heartbeater.cc:507] Master 127.28.198.62:44055 requested a full tablet report, sending...
20:03:05.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.172680 29877 heartbeater.cc:507] Master 127.28.198.60:34329 requested a full tablet report, sending...
20:03:05.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.173974 29578 ts_manager.cc:194] Registered new tserver with Master: 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:05.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.173974 29506 ts_manager.cc:194] Registered new tserver with Master: 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:05.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.175102 29650 ts_manager.cc:194] Registered new tserver with Master: 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:05.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.176091 29650 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.198.1:51815
20:03:05.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.269629 29883 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:05.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.269842 29883 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:05.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.269893 29883 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:05.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.273352 29883 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:05.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.273481 29883 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.198.2
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.277174 29883 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.2:0
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data/info.pb
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.2
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.29883
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.198.2
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/logs
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:05.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.278416 29883 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:05.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.279595 29883 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:05.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.285415 29888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.285420 29891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.285439 29889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.285749 29883 server_base.cc:1061] running on GCE node
20:03:05.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.286026 29883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:05.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.286511 29883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:05.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.287694 29883 hybrid_clock.cc:648] HybridClock initialized: now 1783540985287672 us; error 36 us; skew 500 ppm
20:03:05.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.289381 29883 webserver.cc:533] Webserver started at http://127.28.198.2:35629/ using document root <none> and password file <none>
20:03:05.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.289916 29883 fs_manager.cc:362] Metadata directory not provided
20:03:05.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.290000 29883 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:05.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.290230 29883 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.291661 29883 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data/instance:
20:03:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "434b9913343f49dca4187e692cf7c991"
20:03:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.292183 29883 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal/instance:
20:03:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "434b9913343f49dca4187e692cf7c991"
20:03:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.295176 29883 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
20:03:05.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.297012 29897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:05.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.297811 29883 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.297924 29883 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "434b9913343f49dca4187e692cf7c991"
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.298019 29883 fs_report.cc:389] FS layout report
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data/data
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:05.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:05.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.328569 29883 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:05.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.329286 29883 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:05.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.329481 29883 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:05.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.330014 29883 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:05.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.331046 29883 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:05.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.331118 29883 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:03:05.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.331173 29883 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:05.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.331197 29883 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:05.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.339716 29883 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.2:45873
20:03:05.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.339742 30010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.2:45873 every 8 connection(s)
20:03:05.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.340641 29883 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/data/info.pb
20:03:05.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.345423 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 29883
20:03:05.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.345516 29464 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-1/wal/instance
20:03:05.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.348659 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/logs
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data/info.pb
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.3:0
20:03:05.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.198.3
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.3
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:05.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.351212 30012 heartbeater.cc:344] Connected to a master server at 127.28.198.60:34329
20:03:05.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.351213 30011 heartbeater.cc:344] Connected to a master server at 127.28.198.62:44055
20:03:05.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.351449 30012 heartbeater.cc:461] Registering TS with master...
20:03:05.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.351454 30011 heartbeater.cc:461] Registering TS with master...
20:03:05.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.351289 30013 heartbeater.cc:344] Connected to a master server at 127.28.198.61:41219
20:03:05.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.351765 30013 heartbeater.cc:461] Registering TS with master...
20:03:05.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.352006 30012 heartbeater.cc:507] Master 127.28.198.60:34329 requested a full tablet report, sending...
20:03:05.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.352011 30011 heartbeater.cc:507] Master 127.28.198.62:44055 requested a full tablet report, sending...
20:03:05.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.352288 30013 heartbeater.cc:507] Master 127.28.198.61:41219 requested a full tablet report, sending...
20:03:05.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.353052 29578 ts_manager.cc:194] Registered new tserver with Master: 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873)
20:03:05.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.353053 29650 ts_manager.cc:194] Registered new tserver with Master: 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873)
20:03:05.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.353108 29506 ts_manager.cc:194] Registered new tserver with Master: 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873)
20:03:05.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.353818 29650 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.198.2:38397
20:03:05.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.451653 30018 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:05.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.451834 30018 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:05.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.451872 30018 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:05.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.455145 30018 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:05.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.455238 30018 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.198.3
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.458995 30018 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.3:0
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data/info.pb
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.3
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.30018
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.198.3
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/logs
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.459913 30018 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.461000 30018 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:05.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.466971 30024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.466996 30023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.466996 30026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.467445 30018 server_base.cc:1061] running on GCE node
20:03:05.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.467828 30018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:05.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.468357 30018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:05.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.469538 30018 hybrid_clock.cc:648] HybridClock initialized: now 1783540985469528 us; error 38 us; skew 500 ppm
20:03:05.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.471311 30018 webserver.cc:533] Webserver started at http://127.28.198.3:39589/ using document root <none> and password file <none>
20:03:05.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.471855 30018 fs_manager.cc:362] Metadata directory not provided
20:03:05.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.471944 30018 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:05.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.472189 30018 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:05.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.473769 30018 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data/instance:
20:03:05.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66912979844946f6b88f744da14360ab"
20:03:05.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.474292 30018 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal/instance:
20:03:05.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66912979844946f6b88f744da14360ab"
20:03:05.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.477396 30018 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
20:03:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.479370 30032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.480304 30018 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.480387 30018 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66912979844946f6b88f744da14360ab"
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:05 on dist-test-slave-5qxh"
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.480448 30018 fs_report.cc:389] FS layout report
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data/data
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:05.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:05.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:05.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.507135 30018 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:05.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.507699 30018 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:05.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.507825 30018 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:05.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.508260 30018 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:05.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.509218 30018 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:05.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.509263 30018 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:03:05.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.509300 30018 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:05.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.509315 30018 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:05.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.518693 30018 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.3:41575
20:03:05.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.518748 30145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.3:41575 every 8 connection(s)
20:03:05.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.519655 30018 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/data/info.pb
20:03:05.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.524641 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 30018
20:03:05.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.524731 29464 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/ts-2/wal/instance
20:03:05.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.529321 30148 heartbeater.cc:344] Connected to a master server at 127.28.198.61:41219
20:03:05.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.529420 30147 heartbeater.cc:344] Connected to a master server at 127.28.198.60:34329
20:03:05.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.529737 30147 heartbeater.cc:461] Registering TS with master...
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.530330 30147 heartbeater.cc:507] Master 127.28.198.60:34329 requested a full tablet report, sending...
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.530437 30146 heartbeater.cc:344] Connected to a master server at 127.28.198.62:44055
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.530493 30146 heartbeater.cc:461] Registering TS with master...
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.530645 30146 heartbeater.cc:507] Master 127.28.198.62:44055 requested a full tablet report, sending...
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.531360 30148 heartbeater.cc:461] Registering TS with master...
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.531426 29506 ts_manager.cc:194] Registered new tserver with Master: 66912979844946f6b88f744da14360ab (127.28.198.3:41575)
20:03:05.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.531591 30148 heartbeater.cc:507] Master 127.28.198.61:41219 requested a full tablet report, sending...
20:03:05.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.532236 29578 ts_manager.cc:194] Registered new tserver with Master: 66912979844946f6b88f744da14360ab (127.28.198.3:41575)
20:03:05.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.532378 29650 ts_manager.cc:194] Registered new tserver with Master: 66912979844946f6b88f744da14360ab (127.28.198.3:41575)
20:03:05.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.533036 29650 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.198.3:42275
20:03:05.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.544772 29464 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
20:03:05.545 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:03:05.545 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:03:05.548 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.198.62"
      port: 44055
    }
    bound_http_address {
      host: "127.28.198.62"
      port: 40479
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.198.61"
      port: 41219
    }
    bound_http_address {
      host: "127.28.198.61"
      port: 38219
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.198.60"
      port: 34329
    }
    bound_http_address {
      host: "127.28.198.60"
      port: 36607
    }
  }
}

20:03:05.548 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:03:05.549 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.198.1"
      port: 38699
    }
    bound_http_address {
      host: "127.28.198.1"
      port: 45811
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.198.2"
      port: 45873
    }
    bound_http_address {
      host: "127.28.198.2"
      port: 35629
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.198.3"
      port: 41575
    }
    bound_http_address {
      host: "127.28.198.3"
      port: 39589
    }
  }
}

20:03:05.549 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:03:05.552 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:03:05.554 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.28.198.62:44055(127.28.198.62:44055)] connecting to peer
20:03:05.555 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.28.198.60:34329(127.28.198.60:34329)] connecting to peer
20:03:05.556 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.198.62:44055(127.28.198.62:44055)] Successfully connected to peer
20:03:05.557 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.28.198.61:41219(127.28.198.61:41219)] connecting to peer
20:03:05.558 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.198.60:34329(127.28.198.60:34329)] Successfully connected to peer
20:03:05.560 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.198.62
20:03:05.561 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.198.61:41219(127.28.198.61:41219)] Successfully connected to peer
20:03:05.563 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.198.61
20:03:05.564 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.198.60
20:03:05.577 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xfdfbb1a1, L:/127.0.0.1:56160 - R:/127.28.198.62:44055] using SASL/PLAIN
20:03:05.579 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xb9972d5c, L:/127.0.0.1:38194 - R:/127.28.198.61:41219] using SASL/PLAIN
20:03:05.588 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x1f0ed11f, L:/127.0.0.1:43424 - R:/127.28.198.60:34329] using SASL/PLAIN
20:03:05.590 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:03:05.591 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=37), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [26ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [28ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, deferred=null) after lookup
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.592967 29650 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43424:
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:03:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.594369 29650 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:03:05.607 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table fb6ce489e4894a53a5a6000517516e63
20:03:05.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.618080 29810 tablet_service.cc:1511] Processing CreateTablet for tablet a7e6c24d793245459f100d631d75480d (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=fb6ce489e4894a53a5a6000517516e63]), partition=RANGE (key) PARTITION UNBOUNDED
20:03:05.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.618083 29945 tablet_service.cc:1511] Processing CreateTablet for tablet a7e6c24d793245459f100d631d75480d (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=fb6ce489e4894a53a5a6000517516e63]), partition=RANGE (key) PARTITION UNBOUNDED
20:03:05.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.618392 30080 tablet_service.cc:1511] Processing CreateTablet for tablet a7e6c24d793245459f100d631d75480d (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=fb6ce489e4894a53a5a6000517516e63]), partition=RANGE (key) PARTITION UNBOUNDED
20:03:05.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.619021 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e6c24d793245459f100d631d75480d. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:05.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.619136 29945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e6c24d793245459f100d631d75480d. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:05.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.619138 30080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e6c24d793245459f100d631d75480d. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:05.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.623634 30172 tablet_bootstrap.cc:492] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: Bootstrap starting.
20:03:05.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.624866 30174 tablet_bootstrap.cc:492] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: Bootstrap starting.
20:03:05.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.625042 30173 tablet_bootstrap.cc:492] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: Bootstrap starting.
20:03:05.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.625821 30172 tablet_bootstrap.cc:654] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: Neither blocks nor log segments found. Creating new log.
20:03:05.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.626529 30172 log.cc:826] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: Log is configured to *not* fsync() on all Append() calls
20:03:05.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.626842 30173 tablet_bootstrap.cc:654] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: Neither blocks nor log segments found. Creating new log.
20:03:05.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.626853 30174 tablet_bootstrap.cc:654] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: Neither blocks nor log segments found. Creating new log.
20:03:05.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.628007 30172 tablet_bootstrap.cc:492] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: No bootstrap required, opened a new log
20:03:05.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.628206 30172 ts_tablet_manager.cc:1403] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
20:03:05.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.628348 30174 log.cc:826] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: Log is configured to *not* fsync() on all Append() calls
20:03:05.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.628494 30173 log.cc:826] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: Log is configured to *not* fsync() on all Append() calls
20:03:05.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.629765 30174 tablet_bootstrap.cc:492] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: No bootstrap required, opened a new log
20:03:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.629977 30174 ts_tablet_manager.cc:1403] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
20:03:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.630033 30173 tablet_bootstrap.cc:492] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: No bootstrap required, opened a new log
20:03:05.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.630185 30173 ts_tablet_manager.cc:1403] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.002s
20:03:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.631527 30172 raft_consensus.cc:359] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.631731 30172 raft_consensus.cc:385] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:05.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.631790 30172 raft_consensus.cc:740] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 613ccbdd24e74bd09dd252d758ea41ef, State: Initialized, Role: FOLLOWER
20:03:05.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.632231 30172 consensus_queue.cc:260] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.632323 30174 raft_consensus.cc:359] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.632519 30174 raft_consensus.cc:385] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:05.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.632575 30174 raft_consensus.cc:740] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 434b9913343f49dca4187e692cf7c991, State: Initialized, Role: FOLLOWER
20:03:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.633006 30174 consensus_queue.cc:260] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.633076 30172 ts_tablet_manager.cc:1434] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
20:03:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.633030 30173 raft_consensus.cc:359] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.633201 30173 raft_consensus.cc:385] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.633365 30173 raft_consensus.cc:740] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66912979844946f6b88f744da14360ab, State: Initialized, Role: FOLLOWER
20:03:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.633716 30173 consensus_queue.cc:260] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.634047 29877 heartbeater.cc:499] Master 127.28.198.60:34329 was elected leader, sending a full tablet report...
20:03:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.634212 30174 ts_tablet_manager.cc:1434] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
20:03:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.634732 30173 ts_tablet_manager.cc:1434] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.003s
20:03:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.635083 30147 heartbeater.cc:499] Master 127.28.198.60:34329 was elected leader, sending a full tablet report...
20:03:05.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.636816 30012 heartbeater.cc:499] Master 127.28.198.60:34329 was elected leader, sending a full tablet report...
20:03:05.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.663976 29879 tablet.cc:2406] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:05.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.696189 30178 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:05.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.696393 30178 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.697551 30178 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873), 66912979844946f6b88f744da14360ab (127.28.198.3:41575)
20:03:05.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.701897 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "613ccbdd24e74bd09dd252d758ea41ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66912979844946f6b88f744da14360ab" is_pre_election: true
20:03:05.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.701897 29965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "613ccbdd24e74bd09dd252d758ea41ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434b9913343f49dca4187e692cf7c991" is_pre_election: true
20:03:05.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.702162 29965 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 613ccbdd24e74bd09dd252d758ea41ef in term 0.
20:03:05.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.702162 30100 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 613ccbdd24e74bd09dd252d758ea41ef in term 0.
20:03:05.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.702682 29763 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 613ccbdd24e74bd09dd252d758ea41ef, 66912979844946f6b88f744da14360ab; no voters: 
20:03:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.702890 30178 raft_consensus.cc:2804] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Leader pre-election won for term 1
20:03:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.702960 30178 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:05.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.702999 30178 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 0 FOLLOWER]: Advancing to term 1
20:03:05.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.703926 30178 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.704341 30178 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [CANDIDATE]: Term 1 election: Requested vote from peers 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873), 66912979844946f6b88f744da14360ab (127.28.198.3:41575)
20:03:05.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.704699 29965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "613ccbdd24e74bd09dd252d758ea41ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "434b9913343f49dca4187e692cf7c991"
20:03:05.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.704725 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "613ccbdd24e74bd09dd252d758ea41ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66912979844946f6b88f744da14360ab"
20:03:05.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.704895 30100 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 0 FOLLOWER]: Advancing to term 1
20:03:05.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.704873 29965 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 0 FOLLOWER]: Advancing to term 1
20:03:05.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.705706 30100 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 613ccbdd24e74bd09dd252d758ea41ef in term 1.
20:03:05.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.705786 29965 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 613ccbdd24e74bd09dd252d758ea41ef in term 1.
20:03:05.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.706008 29763 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 613ccbdd24e74bd09dd252d758ea41ef, 66912979844946f6b88f744da14360ab; no voters: 
20:03:05.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.706168 30178 raft_consensus.cc:2804] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 1 FOLLOWER]: Leader election won for term 1
20:03:05.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.706326 30178 raft_consensus.cc:697] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [term 1 LEADER]: Becoming Leader. State: Replica: 613ccbdd24e74bd09dd252d758ea41ef, State: Running, Role: LEADER
20:03:05.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.706640 30178 consensus_queue.cc:237] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:05.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.709844 29650 catalog_manager.cc:5697] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1). New cstate: current_term: 1 leader_uuid: "613ccbdd24e74bd09dd252d758ea41ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } health_report { overall_health: HEALTHY } } }
20:03:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.725270 29720 catalog_manager.cc:1295] Loaded cluster ID: 4214ff1abb174f6aa619f9e82e056bb5
20:03:05.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.725334 29720 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: loading cluster ID for follower catalog manager: success
20:03:05.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.726843 29720 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: acquiring CA information for follower catalog manager: success
20:03:05.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.727823 29720 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:05.739 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table fb6ce489e4894a53a5a6000517516e63
20:03:05.742 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:05.742 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:05.742 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [2ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: OK, deferred=null) after lookup
20:03:05.743 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:05.745 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] Successfully connected to peer
20:03:05.766 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x30860c1c, L:/127.0.0.1:56718 - R:/127.28.198.1:38699] using TOKEN/null
20:03:05.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.770763 30149 tablet.cc:2406] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:05.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.773222 30100 raft_consensus.cc:1275] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Refusing update from remote peer 613ccbdd24e74bd09dd252d758ea41ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:05.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.773273 29965 raft_consensus.cc:1275] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Refusing update from remote peer 613ccbdd24e74bd09dd252d758ea41ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:05.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.773948 30178 consensus_queue.cc:1048] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:05.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.774086 30183 consensus_queue.cc:1048] T a7e6c24d793245459f100d631d75480d P 613ccbdd24e74bd09dd252d758ea41ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:05.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.777377 29734 catalog_manager.cc:1295] Loaded cluster ID: 4214ff1abb174f6aa619f9e82e056bb5
20:03:05.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.777432 29734 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: loading cluster ID for follower catalog manager: success
20:03:05.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.779557 29734 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: acquiring CA information for follower catalog manager: success
20:03:05.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.780695 29734 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:05.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.783387 30187 mvcc.cc:204] Tried to move back new op lower bound from 7305383877719826432 to 7305383877456789504. Current Snapshot: MvccSnapshot[applied={T|T < 7305383877719826432}]
20:03:05.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.786718 30188 mvcc.cc:204] Tried to move back new op lower bound from 7305383877719826432 to 7305383877456789504. Current Snapshot: MvccSnapshot[applied={T|T < 7305383877719826432}]
20:03:05.850 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a7e6c24d793245459f100d631d75480d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:03:05.850 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.28.198.60:34329
20:03:05.851 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:03:05.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.851336 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29616
20:03:05.859 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:03:05.859 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.28.198.60:34329
20:03:05.860 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.198.60:34329(127.28.198.60:34329)] handling channelInactive
20:03:05.860 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.198.60:34329(127.28.198.60:34329)] cleaning up while in state READY due to: connection closed
20:03:05.862 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.863174 29464 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/logs
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/info.pb
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.60:34329
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.60
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36607
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:05.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json with env {}
20:03:05.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.971403 30197 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:05.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.971590 30197 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:05.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.971635 30197 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:05.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.974900 30197 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:05.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.974967 30197 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:05.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.974989 30197 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:05.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.975005 30197 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:05.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.975023 30197 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:05.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.975036 30197 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36623/jwks.json
20:03:05.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.978612 30197 master_runner.cc:387] Master server non-default flags:
20:03:05.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.198.20:44645
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.198.62:44055,127.28.198.61:41219,127.28.198.60:34329
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.198.60:34329
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36623/jwks.json
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/info.pb
20:03:05.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.198.60
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36607
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --heap_profile_path=/tmp/kudu.30197
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/logs
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type DEBUG
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 19:43:16 UTC on bdcb31816ec0
20:03:05.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12776
20:03:05.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.979543 30197 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:05.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.980486 30197 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:05.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.985467 30203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.985433 30202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.985664 30197 server_base.cc:1061] running on GCE node
20:03:05.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:05.985862 30205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.986330 30197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:05.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.987185 30197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:05.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.988337 30197 hybrid_clock.cc:648] HybridClock initialized: now 1783540985988319 us; error 34 us; skew 500 ppm
20:03:05.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.989990 30197 webserver.cc:533] Webserver started at http://127.28.198.60:36607/ using document root <none> and password file <none>
20:03:05.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.990458 30197 fs_manager.cc:362] Metadata directory not provided
20:03:05.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.990517 30197 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:05.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.993996 30197 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.002s
20:03:05.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.995741 30211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:05.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.996673 30197 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.996824 30197 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data,/tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd8ca914b4a2437fa0bc2efb0faf8842"
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 20:03:04 on dist-test-slave-5qxh"
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:05.997211 30197 fs_report.cc:389] FS layout report
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/wal
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/data
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:05.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:05.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:05.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:06.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.018446 30197 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.019099 30197 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:06.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.019313 30197 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:06.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.027259 30263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.198.60:34329 every 8 connection(s)
20:03:06.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.027264 30197 rpc_server.cc:307] RPC server started. Bound to: 127.28.198.60:34329
20:03:06.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.028270 30197 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCEZtFK/test-tmp/mini-kudu-cluster13078221963324390244/master-2/data/info.pb
20:03:06.029 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:03:06.029 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.28.198.1:38699
20:03:06.030 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

20:03:06.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.028911 29464 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu as pid 30197
20:03:06.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.030236 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29748
20:03:06.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.033308 30264 sys_catalog.cc:263] Verifying existing consensus state
20:03:06.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.035535 30264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Bootstrap starting.
20:03:06.039 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] handling channelInactive
20:03:06.039 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:03:06.039 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state READY due to: connection closed
20:03:06.040 [DEBUG - Time-limited test] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:06.042 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:06.042 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:06.042 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:06.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.050945 30264 log.cc:826] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Log is configured to *not* fsync() on all Append() calls
20:03:06.054 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.28.198.60:34329(127.28.198.60:34329)] connecting to peer
20:03:06.056 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.28.198.60:34329(127.28.198.60:34329)] Successfully connected to peer
20:03:06.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.058323 30264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
20:03:06.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.058614 30264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: Bootstrap complete.
20:03:06.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.062294 30264 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:06.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.062865 30264 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd8ca914b4a2437fa0bc2efb0faf8842, State: Initialized, Role: FOLLOWER
20:03:06.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.063494 30264 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:06.063 [DEBUG - kudu-nio-5] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.198.60
20:03:06.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.063902 30270 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:06.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.064144 30270 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: FOLLOWER
20:03:06.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.064667 30264 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: configured and running, proceeding with master startup.
20:03:06.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.069116 30281 catalog_manager.cc:1295] Loaded cluster ID: 4214ff1abb174f6aa619f9e82e056bb5
20:03:06.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.069178 30281 catalog_manager.cc:1588] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: loading cluster ID for follower catalog manager: success
20:03:06.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.071131 30281 catalog_manager.cc:1610] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: acquiring CA information for follower catalog manager: success
20:03:06.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.072499 30281 catalog_manager.cc:1638] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:06.091 [DEBUG - kudu-nio-5] (Negotiator.java:918) Authenticated connection [id: 0x177d55e1, L:/127.0.0.1:43438 - R:/127.28.198.60:34329] using SASL/PLAIN
20:03:06.095 [DEBUG - kudu-nio-5] (RemoteTablet.java:167) master-127.28.198.60:34329 was demoted as the leader for Kudu Master
20:03:06.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.096880 30197 master_runner.cc:264] No leader master found from master cd8ca914b4a2437fa0bc2efb0faf8842
20:03:06.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.096983 30197 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:06.117 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.136 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.157 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.176 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.216 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.277 [WARN - kudu-nio-0] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.357 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.577 [WARN - kudu-nio-0] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:06.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.793804 30228 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "66912979844946f6b88f744da14360ab" instance_seqno: 1783540985515714) as {username='slave'} at 127.28.198.3:43011; Asking this server to re-register.
20:03:06.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.794443 30147 heartbeater.cc:461] Registering TS with master...
20:03:06.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.795499 30228 ts_manager.cc:194] Registered new tserver with Master: 66912979844946f6b88f744da14360ab (127.28.198.3:41575)
20:03:06.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.797089 30228 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "434b9913343f49dca4187e692cf7c991" instance_seqno: 1783540985337532) as {username='slave'} at 127.28.198.2:35495; Asking this server to re-register.
20:03:06.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.797495 30012 heartbeater.cc:461] Registering TS with master...
20:03:06.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:06.798240 30228 ts_manager.cc:194] Registered new tserver with Master: 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873)
20:03:06.877 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219 is a leader; will retry
20:03:07.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.214386 30288 raft_consensus.cc:493] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd8ca914b4a2437fa0bc2efb0faf8842)
20:03:07.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.214520 30288 raft_consensus.cc:515] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:07.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.215471 30289 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd8ca914b4a2437fa0bc2efb0faf8842)
20:03:07.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.215539 30288 leader_election.cc:290] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e53affeac6148caaa5179e2f3e9b7f3 (127.28.198.61:41219), cd8ca914b4a2437fa0bc2efb0faf8842 (127.28.198.60:34329)
20:03:07.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.215590 30289 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:07.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.215969 29588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" is_pre_election: true
20:03:07.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216078 29588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a88b821ddd4fc4accf3b93d8f2a36d in term 1.
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216457 30289 leader_election.cc:290] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48a88b821ddd4fc4accf3b93d8f2a36d (127.28.198.62:44055), cd8ca914b4a2437fa0bc2efb0faf8842 (127.28.198.60:34329)
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216464 29490 leader_election.cc:304] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a88b821ddd4fc4accf3b93d8f2a36d, 7e53affeac6148caaa5179e2f3e9b7f3; no voters: 
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216756 30288 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Leader pre-election won for term 2
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216813 30288 raft_consensus.cc:493] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd8ca914b4a2437fa0bc2efb0faf8842)
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216859 30288 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 1 FOLLOWER]: Advancing to term 2
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.216887 29516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" is_pre_election: true
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.218518 30288 raft_consensus.cc:515] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:07.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.218720 29516 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e53affeac6148caaa5179e2f3e9b7f3 in current term 2: Already voted for candidate 48a88b821ddd4fc4accf3b93d8f2a36d in this term.
20:03:07.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.219064 30288 leader_election.cc:290] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [CANDIDATE]: Term 2 election: Requested vote from peers 7e53affeac6148caaa5179e2f3e9b7f3 (127.28.198.61:41219), cd8ca914b4a2437fa0bc2efb0faf8842 (127.28.198.60:34329)
20:03:07.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.219090 29588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "7e53affeac6148caaa5179e2f3e9b7f3"
20:03:07.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.219182 29588 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 1 FOLLOWER]: Advancing to term 2
20:03:07.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.220217 29588 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a88b821ddd4fc4accf3b93d8f2a36d in term 2.
20:03:07.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.220489 29490 leader_election.cc:304] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a88b821ddd4fc4accf3b93d8f2a36d, 7e53affeac6148caaa5179e2f3e9b7f3; no voters: 
20:03:07.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.220667 30288 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 2 FOLLOWER]: Leader election won for term 2
20:03:07.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.220834 30288 raft_consensus.cc:697] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [term 2 LEADER]: Becoming Leader. State: Replica: 48a88b821ddd4fc4accf3b93d8f2a36d, State: Running, Role: LEADER
20:03:07.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221143 30288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } }
20:03:07.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221132 30238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842"
20:03:07.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221292 30230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" is_pre_election: true
20:03:07.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221451 30230 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e53affeac6148caaa5179e2f3e9b7f3 in term 1.
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221128 30231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" is_pre_election: true
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221683 30231 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a88b821ddd4fc4accf3b93d8f2a36d in term 1.
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.221845 29565 leader_election.cc:304] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e53affeac6148caaa5179e2f3e9b7f3, cd8ca914b4a2437fa0bc2efb0faf8842; no voters: 48a88b821ddd4fc4accf3b93d8f2a36d
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.222151 30289 raft_consensus.cc:2764] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.222445 30293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48a88b821ddd4fc4accf3b93d8f2a36d. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.222520 30293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: This master's current role is: LEADER
20:03:07.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.222790 30295 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
20:03:07.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.223929 30295 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=fb6ce489e4894a53a5a6000517516e63]
20:03:07.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.224707 30295 tablet_loader.cc:96] loaded metadata for tablet a7e6c24d793245459f100d631d75480d (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=fb6ce489e4894a53a5a6000517516e63])
20:03:07.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.224877 30295 catalog_manager.cc:1520] Initializing Kudu cluster ID...
20:03:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.225173 30295 catalog_manager.cc:1295] Loaded cluster ID: 4214ff1abb174f6aa619f9e82e056bb5
20:03:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.225210 30295 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
20:03:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.225647 30295 catalog_manager.cc:1540] Loading token signing keys...
20:03:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.225965 30295 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: Loaded TSK: 0
20:03:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.226446 30295 catalog_manager.cc:1550] Initializing in-progress tserver states...
20:03:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.343447 30296 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 613ccbdd24e74bd09dd252d758ea41ef)
20:03:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.343605 30296 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.343811 30297 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 613ccbdd24e74bd09dd252d758ea41ef)
20:03:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.343901 30297 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.344746 30296 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873), 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.344890 30297 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66912979844946f6b88f744da14360ab (127.28.198.3:41575), 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:07.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:07.345662 29898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:07.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:07.345839 30033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:07.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:07.346743 29898 leader_election.cc:336] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:07.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:07.346900 30033 leader_election.cc:336] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.348912 29965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "66912979844946f6b88f744da14360ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "434b9913343f49dca4187e692cf7c991" is_pre_election: true
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.348944 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "434b9913343f49dca4187e692cf7c991" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "66912979844946f6b88f744da14360ab" is_pre_election: true
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349018 29965 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66912979844946f6b88f744da14360ab in term 1.
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349076 30100 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 434b9913343f49dca4187e692cf7c991 in term 1.
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349306 30033 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434b9913343f49dca4187e692cf7c991, 66912979844946f6b88f744da14360ab; no voters: 613ccbdd24e74bd09dd252d758ea41ef
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349391 29898 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434b9913343f49dca4187e692cf7c991, 66912979844946f6b88f744da14360ab; no voters: 613ccbdd24e74bd09dd252d758ea41ef
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349545 30296 raft_consensus.cc:2804] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Leader pre-election won for term 2
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349607 30296 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 613ccbdd24e74bd09dd252d758ea41ef)
20:03:07.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.349647 30296 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 1 FOLLOWER]: Advancing to term 2
20:03:07.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.350005 30297 raft_consensus.cc:2804] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:03:07.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.350070 30297 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 613ccbdd24e74bd09dd252d758ea41ef)
20:03:07.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.350112 30297 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 1 FOLLOWER]: Advancing to term 2
20:03:07.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.350732 30296 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:07.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.351079 30297 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:07.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.351133 30296 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 2 election: Requested vote from peers 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873), 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:07.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.351431 30297 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [CANDIDATE]: Term 2 election: Requested vote from peers 66912979844946f6b88f744da14360ab (127.28.198.3:41575), 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:07.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.351432 29965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "66912979844946f6b88f744da14360ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "434b9913343f49dca4187e692cf7c991"
20:03:07.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.351652 29965 raft_consensus.cc:2393] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66912979844946f6b88f744da14360ab in current term 2: Already voted for candidate 434b9913343f49dca4187e692cf7c991 in this term.
20:03:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.351995 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "434b9913343f49dca4187e692cf7c991" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "66912979844946f6b88f744da14360ab"
20:03:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.352141 30100 raft_consensus.cc:2393] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 434b9913343f49dca4187e692cf7c991 in current term 2: Already voted for candidate 66912979844946f6b88f744da14360ab in this term.
20:03:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:07.352367 30033 leader_election.cc:336] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.352442 30033 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66912979844946f6b88f744da14360ab; no voters: 434b9913343f49dca4187e692cf7c991, 613ccbdd24e74bd09dd252d758ea41ef
20:03:07.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.352662 30296 raft_consensus.cc:2749] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:03:07.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:07.353413 29898 leader_election.cc:336] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:07.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.353521 29898 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 434b9913343f49dca4187e692cf7c991; no voters: 613ccbdd24e74bd09dd252d758ea41ef, 66912979844946f6b88f744da14360ab
20:03:07.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.353690 30297 raft_consensus.cc:2749] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
20:03:07.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.766942 29588 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [term 2 FOLLOWER]: Refusing update from remote peer 48a88b821ddd4fc4accf3b93d8f2a36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
20:03:07.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.767517 30306 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
20:03:07.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.768652 30307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48a88b821ddd4fc4accf3b93d8f2a36d. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:07.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.768764 30307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:07.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.769966 30309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:07.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.770329 30309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: This master's current role is: LEADER
20:03:07.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.770293 30307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:07.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.770394 30307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e53affeac6148caaa5179e2f3e9b7f3 [sys.catalog]: This master's current role is: FOLLOWER
20:03:07.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.770650 30231 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 1 FOLLOWER]: Advancing to term 2
20:03:07.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.772532 30231 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [term 2 FOLLOWER]: Refusing update from remote peer 48a88b821ddd4fc4accf3b93d8f2a36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
20:03:07.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.773120 30309 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
20:03:07.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.774914 30317 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:07.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.775192 30317 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: FOLLOWER
20:03:07.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.775362 30314 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48a88b821ddd4fc4accf3b93d8f2a36d. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:07.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:07.775461 30314 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8ca914b4a2437fa0bc2efb0faf8842 [sys.catalog]: This master's current role is: FOLLOWER
20:03:07.898 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:03:07.899 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29986, elapsed=1844), Traces: [0ms] sending RPC to server master-127.28.198.60:34329, [41ms] delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [41ms] received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [62ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [63ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [82ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [103ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [122ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [122ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [162ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [163ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [222ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [223ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [300ms] refreshing cache from master, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [303ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [303ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [520ms] refreshing cache from master, [520ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [521ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [523ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [523ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [820ms] refreshing cache from master, [820ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [821ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [822ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [823ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [823ms] delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1840ms] refreshing cache from master, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1840ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1841ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1842ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1843ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, deferred=Deferred@1382329914(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC -> (continuation of Deferred@1037807101 after retry RPC after error@1677492203) -> (continuation of Deferred@1168712324 after retry RPC after error@843796853) -> (continuation of Deferred@1377805956 after retry RPC after error@1385994251) -> (continuation of Deferred@1588407774 after retry RPC after error@906301319) -> (continuation of Deferred@419542085 after retry RPC after error@803945390) -> (continuation of Deferred@413081680 after retry RPC after error@108559859) -> (continuation of Deferred@307184357 after retry RPC after error@1678716233) -> (continuation of Deferred@99814456 after retry RPC after error@1084321424) -> (continuation of Deferred@672224267 after retry RPC after error@904479013), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1037807101 after retry RPC after error@1677492203) -> (continuation of Deferred@1168712324 after retry RPC after error@843796853) -> (continuation of Deferred@1377805956 after retry RPC after error@1385994251) -> (continuation of Deferred@1588407774 after retry RPC after error@906301319) -> (continuation of Deferred@419542085 after retry RPC after error@803945390) -> (continuation of Deferred@413081680 after retry RPC after error@108559859) -> (continuation of Deferred@307184357 after retry RPC after error@1678716233) -> (continuation of Deferred@99814456 after retry RPC after error@1084321424) -> (continuation of Deferred@672224267 after retry RPC after error@904479013))) after lookup
20:03:07.902 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:07.902 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:07.903 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1863), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test)) after lookup
20:03:07.904 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:07.905 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.906 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.906 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.916 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:07.917 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:07.917 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1877), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1865ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1867ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1867ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1875ms] refreshing cache from master, [1875ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1877ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997))) after lookup
20:03:07.918 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:07.920 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.920 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.920 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.956 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:07.956 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:07.957 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1917), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1865ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1867ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1867ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1875ms] refreshing cache from master, [1875ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1877ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1879ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1881ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1881ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1915ms] refreshing cache from master, [1915ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1917ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959))) after lookup
20:03:07.958 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:07.959 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.959 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:07.959 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.076 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:08.077 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:08.077 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2037), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1865ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1867ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1867ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1875ms] refreshing cache from master, [1875ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1877ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1879ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1881ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1881ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1915ms] refreshing cache from master, [1915ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1917ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1919ms] too many traces: truncated at 100 traces, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630))) after lookup
20:03:08.078 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:08.079 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.079 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.080 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.296 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:08.297 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:08.298 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2257), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1865ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1867ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1867ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1875ms] refreshing cache from master, [1875ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1877ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1879ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1881ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1881ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1915ms] refreshing cache from master, [1915ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1917ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1919ms] too many traces: truncated at 100 traces, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630) -> (continuation of Deferred@690095909 after retry RPC@420700123), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630) -> (continuation of Deferred@690095909 after retry RPC@420700123))) after lookup
20:03:08.299 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:08.300 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.300 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.300 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:08.368813 30309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } }
20:03:08.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:08.368958 30309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d [sys.catalog]: This master's current role is: LEADER
20:03:08.717 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:08.717 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)[L],66912979844946f6b88f744da14360ab(127.28.198.3:41575)]}]
20:03:08.718 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2678), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1865ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1867ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1867ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1875ms] refreshing cache from master, [1875ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1877ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1879ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1881ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1881ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1915ms] refreshing cache from master, [1915ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1917ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1919ms] too many traces: truncated at 100 traces, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630) -> (continuation of Deferred@690095909 after retry RPC@420700123) -> (continuation of Deferred@1207360306 after retry RPC@1142466960), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630) -> (continuation of Deferred@690095909 after retry RPC@420700123) -> (continuation of Deferred@1207360306 after retry RPC@1142466960))) after lookup
20:03:08.720 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] connecting to peer
20:03:08.721 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.721 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] cleaning up while in state CONNECTING due to: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.721 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699) for tablet a7e6c24d793245459f100d631d75480d: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699
20:03:08.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:08.791311 30146 heartbeater.cc:499] Master 127.28.198.62:44055 was elected leader, sending a full tablet report...
20:03:08.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:08.795686 30011 heartbeater.cc:499] Master 127.28.198.62:44055 was elected leader, sending a full tablet report...
20:03:09.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.001201 30323 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:09.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.001329 30323 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:09.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.001765 30323 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873), 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:09.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.002236 29965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "66912979844946f6b88f744da14360ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "434b9913343f49dca4187e692cf7c991" is_pre_election: true
20:03:09.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.002393 29965 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66912979844946f6b88f744da14360ab in term 2.
20:03:09.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.002768 30033 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 434b9913343f49dca4187e692cf7c991, 66912979844946f6b88f744da14360ab; no voters: 
20:03:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.002951 30323 raft_consensus.cc:2804] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Leader pre-election won for term 3
20:03:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.003039 30323 raft_consensus.cc:493] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.003065 30323 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 2 FOLLOWER]: Advancing to term 3
20:03:09.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:09.003366 30033 leader_election.cc:336] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.003928 30323 raft_consensus.cc:515] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.004213 30323 leader_election.cc:290] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 3 election: Requested vote from peers 434b9913343f49dca4187e692cf7c991 (127.28.198.2:45873), 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699)
20:03:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.004531 29965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e6c24d793245459f100d631d75480d" candidate_uuid: "66912979844946f6b88f744da14360ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "434b9913343f49dca4187e692cf7c991"
20:03:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.004655 29965 raft_consensus.cc:3060] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 2 FOLLOWER]: Advancing to term 3
20:03:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:09.005226 30033 leader_election.cc:336] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.005549 29965 raft_consensus.cc:2468] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66912979844946f6b88f744da14360ab in term 3.
20:03:09.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.005838 30033 leader_election.cc:304] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 434b9913343f49dca4187e692cf7c991, 66912979844946f6b88f744da14360ab; no voters: 613ccbdd24e74bd09dd252d758ea41ef
20:03:09.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.006002 30323 raft_consensus.cc:2804] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 3 FOLLOWER]: Leader election won for term 3
20:03:09.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.006177 30323 raft_consensus.cc:697] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [term 3 LEADER]: Becoming Leader. State: Replica: 66912979844946f6b88f744da14360ab, State: Running, Role: LEADER
20:03:09.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.006512 30323 consensus_queue.cc:237] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } }
20:03:09.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.009126 29506 catalog_manager.cc:5697] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab reported cstate change: term changed from 1 to 3, leader changed from 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1) to 66912979844946f6b88f744da14360ab (127.28.198.3). New cstate: current_term: 3 leader_uuid: "66912979844946f6b88f744da14360ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66912979844946f6b88f744da14360ab" member_type: VOTER last_known_addr { host: "127.28.198.3" port: 41575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "613ccbdd24e74bd09dd252d758ea41ef" member_type: VOTER last_known_addr { host: "127.28.198.1" port: 38699 } health_report { overall_health: UNKNOWN } } }
20:03:09.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.491590 29965 raft_consensus.cc:1275] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 3 FOLLOWER]: Refusing update from remote peer 66912979844946f6b88f744da14360ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 3 index: 12. (index mismatch)
20:03:09.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:09.492125 30323 consensus_queue.cc:1048] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "434b9913343f49dca4187e692cf7c991" member_type: VOTER last_known_addr { host: "127.28.198.2" port: 45873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
20:03:09.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:09.496716 30033 consensus_peers.cc:597] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab -> Peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Couldn't send request to peer 613ccbdd24e74bd09dd252d758ea41ef. Status: Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:03:11.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:11.954346 30033 consensus_peers.cc:597] T a7e6c24d793245459f100d631d75480d P 66912979844946f6b88f744da14360ab -> Peer 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): Couldn't send request to peer 613ccbdd24e74bd09dd252d758ea41ef. Status: Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
20:03:12.077 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet a7e6c24d793245459f100d631d75480d for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
20:03:12.077 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=a7e6c24d793245459f100d631d75480d@[434b9913343f49dca4187e692cf7c991(127.28.198.2:45873),613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699),66912979844946f6b88f744da14360ab(127.28.198.3:41575)[L]]}]
20:03:12.078 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=a7e6c24d793245459f100d631d75480d, attempt=14, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=6038), Traces: [0ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [3ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [3ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [15ms] refreshing cache from master, [15ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.60:34329, [56ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [56ms] Sub RPC GetTableLocations: received response from server master-127.28.198.60:34329: Illegal state: Not the leader. Local UUID: cd8ca914b4a2437fa0bc2efb0faf8842, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a88b821ddd4fc4accf3b93d8f2a36d" member_type: VOTER last_known_addr { host: "127.28.198.62" port: 44055 } } peers { permanent_uuid: "7e53affeac6148caaa5179e2f3e9b7f3" member_type: VOTER last_known_addr { host: "127.28.198.61" port: 41219 } } peers { permanent_uuid: "cd8ca914b4a2437fa0bc2efb0faf8842" member_type: VOTER last_known_addr { host: "127.28.198.60" port: 34329 } } } (error 0), [75ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [95ms] Sub RPC GetTableLocations: refreshing cache from master, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [115ms] Sub RPC GetTableLocations: refreshing cache from master, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [135ms] Sub RPC GetTableLocations: refreshing cache from master, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [135ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [137ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [137ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [175ms] Sub RPC GetTableLocations: refreshing cache from master, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [175ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [177ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [178ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [235ms] Sub RPC GetTableLocations: refreshing cache from master, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [235ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [237ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [238ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [315ms] Sub RPC GetTableLocations: refreshing cache from master, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [316ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [318ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [318ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [535ms] Sub RPC GetTableLocations: refreshing cache from master, [535ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [536ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [538ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [538ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [835ms] Sub RPC GetTableLocations: refreshing cache from master, [835ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [836ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [837ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [838ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [838ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.28.198.62:44055,127.28.198.60:34329,127.28.198.61:41219) has no leader., [1855ms] Sub RPC GetTableLocations: refreshing cache from master, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.62:44055, [1855ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.60:34329, [1856ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.198.61:41219, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.61:41219: OK, [1857ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.60:34329: OK, [1858ms] Sub RPC ConnectToMaster: received response from server master-127.28.198.62:44055: OK, [1860ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1863ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1865ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1867ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1867ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1875ms] refreshing cache from master, [1875ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1877ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1879ms] sending RPC to server 613ccbdd24e74bd09dd252d758ea41ef, [1881ms] received response from server 613ccbdd24e74bd09dd252d758ea41ef: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1881ms] delaying RPC due to: Network error: Failed to connect to peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699): Connection refused: /127.28.198.1:38699, [1915ms] refreshing cache from master, [1915ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.198.62:44055, [1917ms] Sub RPC GetTableLocations: received response from server master-127.28.198.62:44055: OK, [1919ms] too many traces: truncated at 100 traces, deferred=Deferred@1677207326(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f1d8c336bb8@416b9666 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630) -> (continuation of Deferred@690095909 after retry RPC@420700123) -> (continuation of Deferred@1207360306 after retry RPC@1142466960) -> (continuation of Deferred@1383908042 after retry RPC@1395238204), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3ef41707 -> wakeup thread Time-limited test -> (continuation of Deferred@1382329914 after retry RPC@120899997) -> (continuation of Deferred@941865690 after retry RPC@1342116959) -> (continuation of Deferred@114184577 after retry RPC@1071770630) -> (continuation of Deferred@690095909 after retry RPC@420700123) -> (continuation of Deferred@1207360306 after retry RPC@1142466960) -> (continuation of Deferred@1383908042 after retry RPC@1395238204))) after lookup
20:03:12.079 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 66912979844946f6b88f744da14360ab(127.28.198.3:41575)] connecting to peer
20:03:12.080 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 66912979844946f6b88f744da14360ab(127.28.198.3:41575)] Successfully connected to peer
20:03:12.100 [DEBUG - kudu-nio-4] (Negotiator.java:918) Authenticated connection [id: 0x43c1d75c, L:/127.0.0.1:44608 - R:/127.28.198.3:41575] using TOKEN/null
20:03:12.160 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=a7e6c24d793245459f100d631d75480d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:03:12.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.162109 29504 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56160:
20:03:12.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
20:03:12.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.162310 29504 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56160:
20:03:12.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
20:03:12.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.170071 29504 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 48a88b821ddd4fc4accf3b93d8f2a36d: Sending DeleteTablet for 3 replicas of tablet a7e6c24d793245459f100d631d75480d
20:03:12.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:12.174887 29490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111) [suppressed 4 similar messages]
20:03:12.177 [DEBUG - main] (Connection.java:575) [peer 613ccbdd24e74bd09dd252d758ea41ef(127.28.198.1:38699)] disconnecting while in state TERMINATED
20:03:12.177 [DEBUG - main] (Connection.java:575) [peer 66912979844946f6b88f744da14360ab(127.28.198.3:41575)] disconnecting while in state READY
20:03:12.177 [DEBUG - main] (Connection.java:575) [peer master-127.28.198.62:44055(127.28.198.62:44055)] disconnecting while in state READY
20:03:12.177 [DEBUG - main] (Connection.java:575) [peer master-127.28.198.60:34329(127.28.198.60:34329)] disconnecting while in state READY
20:03:12.177 [DEBUG - main] (Connection.java:575) [peer master-127.28.198.61:41219(127.28.198.61:41219)] disconnecting while in state READY
20:03:12.178 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 66912979844946f6b88f744da14360ab(127.28.198.3:41575)] handling channelInactive
20:03:12.178 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 66912979844946f6b88f744da14360ab(127.28.198.3:41575)] cleaning up while in state READY due to: connection closed
20:03:12.179 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.28.198.60:34329(127.28.198.60:34329)] handling channelInactive
20:03:12.179 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.28.198.60:34329(127.28.198.60:34329)] cleaning up while in state READY due to: connection closed
20:03:12.180 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.198.61:41219(127.28.198.61:41219)] handling channelInactive
20:03:12.181 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.198.61:41219(127.28.198.61:41219)] cleaning up while in state READY due to: connection closed
20:03:12.182 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:03:12.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.183409 29945 tablet_service.cc:1558] Processing DeleteTablet for tablet a7e6c24d793245459f100d631d75480d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 20:03:12 UTC) from {username='slave'} at 127.0.0.1:47464
20:03:12.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.183976 30375 tablet_replica.cc:333] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: stopping tablet replica
20:03:12.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.184283 30375 raft_consensus.cc:2243] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 3 FOLLOWER]: Raft consensus shutting down.
20:03:12.184 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.198.62:44055(127.28.198.62:44055)] handling channelInactive
20:03:12.184 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.198.62:44055(127.28.198.62:44055)] cleaning up while in state READY due to: connection closed
20:03:12.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.184918 30375 raft_consensus.cc:2272] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991 [term 3 FOLLOWER]: Raft consensus is shut down!
20:03:12.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.186594 30375 ts_tablet_manager.cc:1916] T a7e6c24d793245459f100d631d75480d P 434b9913343f49dca4187e692cf7c991: Deleting tablet data with delete state TABLET_DATA_DELETED
20:03:12.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.186688 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29883
20:03:12.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.189970 30080 tablet_service.cc:1558] Processing DeleteTablet for tablet a7e6c24d793245459f100d631d75480d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 20:03:12 UTC) from {username='slave'} at 127.0.0.1:44614
20:03:12.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:12.190403 29490 catalog_manager.cc:4755] TS 613ccbdd24e74bd09dd252d758ea41ef (127.28.198.1:38699): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7e6c24d793245459f100d631d75480d: Network error: Client connection negotiation failed: client connection to 127.28.198.1:38699: connect: Connection refused (error 111)
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.195014 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 30018
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 20:03:12.195289 30370 negotiation.cc:336] Failed RPC negotiation. Trace:
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 20:03:12.194131 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.28.198.2:45873 (local address 127.0.0.1:47468)
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 20:03:12.194259 (+   128us) negotiation.cc:107] Waiting for socket to connect
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 20:03:12.194274 (+    15us) client_negotiation.cc:175] Beginning negotiation
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 20:03:12.194367 (+    93us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 20:03:12.194764 (+   397us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.198.2:45873: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:03:12.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":49}
20:03:12.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.203075 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29475
20:03:12.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.209666 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 29546
20:03:12.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 20:03:12.215597 29464 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCEZtFK/build/debug/bin/kudu with pid 30197
20:03:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T20:03:12Z chronyd exiting

Time: 17.666

OK (2 tests)

